-- Logs begin at Wed 2022-09-21 04:48:49 UTC, end at Wed 2022-09-21 05:48:25 UTC. -- Sep 21 05:13:33.494987 dv-cinder-849143-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 21 05:13:33.505641 dv-cinder-849143-5-smb devstack@keystone.service[81341]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 21 05:13:33.508383 dv-cinder-849143-5-smb devstack@keystone.service[81341]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 05:13:33 2022] *** Sep 21 05:13:33.508575 dv-cinder-849143-5-smb devstack@keystone.service[81341]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 05:13:33.508778 dv-cinder-849143-5-smb devstack@keystone.service[81341]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 05:13:33.508992 dv-cinder-849143-5-smb devstack@keystone.service[81341]: nodename: dv-cinder-849143-5-smb Sep 21 05:13:33.509190 dv-cinder-849143-5-smb devstack@keystone.service[81341]: machine: x86_64 Sep 21 05:13:33.509190 dv-cinder-849143-5-smb devstack@keystone.service[81341]: clock source: unix Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: pcre jit disabled Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: detected number of CPU cores: 4 Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: current working directory: / Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: detected binary path: /usr/bin/uwsgi-core Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: your processes number limit is 47680 Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: your memory page size is 4096 bytes Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: detected max file descriptor number: 2048 Sep 21 05:13:33.509362 dv-cinder-849143-5-smb devstack@keystone.service[81341]: lock engine: pthread robust mutexes Sep 21 05:13:33.509739 dv-cinder-849143-5-smb devstack@keystone.service[81341]: thunder lock: enabled Sep 21 05:13:33.509938 dv-cinder-849143-5-smb devstack@keystone.service[81341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 21 05:13:33.510108 dv-cinder-849143-5-smb devstack@keystone.service[81341]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 05:13:33.549100 dv-cinder-849143-5-smb devstack@keystone.service[81341]: Python main interpreter initialized at 0x55f8a36829c0 Sep 21 05:13:33.549100 dv-cinder-849143-5-smb devstack@keystone.service[81341]: python threads support enabled Sep 21 05:13:33.549100 dv-cinder-849143-5-smb devstack@keystone.service[81341]: your server socket listen backlog is limited to 100 connections Sep 21 05:13:33.549100 dv-cinder-849143-5-smb devstack@keystone.service[81341]: your mercy for graceful operations on workers is 90 seconds Sep 21 05:13:33.549417 dv-cinder-849143-5-smb devstack@keystone.service[81341]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 05:13:33.549504 dv-cinder-849143-5-smb devstack@keystone.service[81341]: *** Operational MODE: preforking *** Sep 21 05:13:33.549761 dv-cinder-849143-5-smb devstack@keystone.service[81341]: *** uWSGI is running in multiple interpreter mode *** Sep 21 05:13:33.549761 dv-cinder-849143-5-smb devstack@keystone.service[81341]: spawned uWSGI master process (pid: 81341) Sep 21 05:13:33.549959 dv-cinder-849143-5-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 21 05:13:33.551336 dv-cinder-849143-5-smb devstack@keystone.service[81341]: spawned uWSGI worker 1 (pid: 81350, cores: 1) Sep 21 05:13:33.551336 dv-cinder-849143-5-smb devstack@keystone.service[81341]: spawned uWSGI worker 2 (pid: 81351, cores: 1) Sep 21 05:13:33.551336 dv-cinder-849143-5-smb devstack@keystone.service[81341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 05:13:37.822359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 05:13:37.822359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: from cryptography.utils import int_from_bytes Sep 21 05:13:37.823162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 05:13:37.823162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: from cryptography.utils import int_from_bytes Sep 21 05:13:37.824617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 05:13:37.824617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: from cryptography.utils import int_from_bytes Sep 21 05:13:37.825068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 05:13:37.825068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: from cryptography.utils import int_from_bytes Sep 21 05:13:37.872867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 05:13:37.873066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 05:13:37.873261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] command line args: [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 05:13:37.873531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 05:13:37.873711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ================================================================================ {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 05:13:37.873966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] admin_token = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.874216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] config_dir = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.874408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.874592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] config_source = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.874679 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 05:13:37.874774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] debug = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.874858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 05:13:37.874982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.875216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] command line args: [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 05:13:37.875333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 05:13:37.875412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.875472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ================================================================================ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 05:13:37.875540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.875731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] admin_token = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.875816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.875976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config_dir = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] list_limit = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] config_source = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] log_config_append = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] debug = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] log_dir = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] log_file = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.876994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.877942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_config_append = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_dir = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.878883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.879867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.880035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.880114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.880318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.880407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.880534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.881312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.881388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.881539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] publish_errors = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.881633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.881768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.881849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.881996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.882116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.882189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.882309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.882410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.882496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.882648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.882886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] standard_threads = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.883120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.883295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.883378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.883526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.883611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] publish_errors = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.883706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] use_journal = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.883883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] use_json = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.884006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.884088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] use_stderr = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.884223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] use_syslog = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.884478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.884555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.884737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.884813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.884985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.885249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.885334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.885491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.885699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.885774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.885966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.886110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] standard_threads = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.886214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.886452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.886560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.886700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.886948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.887034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.887201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.887359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.887441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.887670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.887750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_journal = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.887908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.888014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_json = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.888157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.888343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_stderr = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.888432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.888663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] use_syslog = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.888747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.888916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.889075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 05:13:37.889173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.889410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.889493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.889647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.889788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.889900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.890165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.890246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.890419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.890615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.890698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.890889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.891047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.891125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.891341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.891425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.891578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.891777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.891856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.892065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.892183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.892357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.892540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.892616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.892790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.893953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.894971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.895918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.896921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.897883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.898986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.899931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.900972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.901918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.902074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.902141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.902384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.902656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.902656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.902847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.902922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.903964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.904911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905399 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.905874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.906979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.907998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.908160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.908245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.908418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.908504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.908652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.908728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.908901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.909140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.909377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.909621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.909858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.910106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.910344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.910581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.910818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.911053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.911278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.911355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.911540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.911782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.912059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.912320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.912563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.912806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.913043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.913280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.913515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.913746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.913879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.913976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.914974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.915133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.915218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] auth.external = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.915380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.915457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.915618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.915749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.915877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] auth.password = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] auth.token = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916638 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.external = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.916858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.password = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.917854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] auth.token = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] credential.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.918994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.919957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.920953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.921926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.922933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.923914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.924947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.925968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.926092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.926214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.926339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.926536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.926661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.926800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.926925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.927050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.927174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.927304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.927912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.928918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.929924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.930935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.931919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.932942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.933957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.934935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.935925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936171 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.936980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937347 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.937857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.938955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.939964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.940984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.941972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.942958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.943083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.943827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.943955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.944085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.944208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.944375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.944496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.944621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.944744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.944878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.945887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.946889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.947900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.948948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.949947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.950940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] role.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] role.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.951996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.952122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.952243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.952400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.952522 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.952647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.952771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.952895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.953922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.954916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955414 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.955905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.956956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.957959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.958871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959112 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.959980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.960983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.961938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.962927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.963911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.connection = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.964927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.965949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.966931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967057 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.967929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.968962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 05:13:37.969572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 05:13:37.969572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 05:13:37.995185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:37.995414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:37.995638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:37.996489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:37.996723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:37.996945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.004224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.005228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.032519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.032749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.033278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.033512 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.085885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.086352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.134925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.135158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.135424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.135667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.292244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.292498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.292723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.292945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.293164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.293381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.293556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.293791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.294014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.294233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.294450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.294665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.316777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.317985 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.318140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.318223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.318389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.329205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.329490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.341847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.342974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.343102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.343184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.343320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.343538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 05:13:38.360192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.360422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 05:13:38.360665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.360769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.360878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 05:13:38.360960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 05:13:38.361217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.361302 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.361418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 05:13:38.361500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.361694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.361784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.361956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.362038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.362218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.362480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.372408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.372692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.372804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.372968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.373082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.373253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.373344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.373620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.380169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.380556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.383120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.383408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.383491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.383693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.383776 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.383975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.384058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.384262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.384366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.384553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.384635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.384818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.384911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385638 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.385987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.386174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.408367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.408551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.409852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.410077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.410159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.410364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.415273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.415496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.415579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.415782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.415865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.416064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.422174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.422346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.422466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.422635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.428559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.428793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.428880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.429092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.429173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.429382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.429472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.429671 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.429754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.429943 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.430025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.430215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.430300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.430482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.430564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.430752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.445874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.446143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.446230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.446422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.449994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.450392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.453281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.453581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.453661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.453879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.457783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.458054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.461238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.461365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.464477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.464601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.464777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.464904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.465062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.465194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.465347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.465480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.465626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.465758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.465916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.466037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.482147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.482242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.482439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.482522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.482707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.482788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.482972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.483055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.489772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.489862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.491853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.491984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.493419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.493507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.493698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.493779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.496610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.496715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.496896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.496978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.497179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.497260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.497465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.497550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.497859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.497956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.508953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.509060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.509242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.509326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.509527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.509618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.509812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.509895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.510189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.510272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.510469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.510560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.510763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.510845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.526008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.526102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.528914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.529007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.531773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.531855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.533248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.533348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.534702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.534820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.534988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.535109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.535396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.535529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.542231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.542379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.543691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.543813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.546576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.546717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.546974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.547113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.547266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.547407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.547546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.547689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.555980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.556073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.556269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.556376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.556578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.556661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.563390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.563478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 05:13:38.563676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.563760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.563957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.564039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.564234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.564330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.564535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.564621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.564808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.564890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.565992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.566198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.566280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.566459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.566543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.566725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.566806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.566986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.567066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 05:13:38.601746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8a36829c0 pid: 81350 (default app) Sep 21 05:13:38.601848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8a36829c0 pid: 81351 (default app) Sep 21 05:13:38.604976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e28d55-35e7-4c96-abd7-c3598f5dd88c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:38.605265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e28d55-35e7-4c96-abd7-c3598f5dd88c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:38.605541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e28d55-35e7-4c96-abd7-c3598f5dd88c None None] PATH_INFO: `/v3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:38.609656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Sep 21 05:13:38 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:13:45.376354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8e56-8f57-4250-9b43-1d3444df93a0 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:45.376845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8e56-8f57-4250-9b43-1d3444df93a0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:45.376944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8e56-8f57-4250-9b43-1d3444df93a0 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:45.381184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:45.386454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:45.387022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:45.387022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:45.456420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: INFO dbcounter [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] Registered counter for database keystone Sep 21 05:13:45.475889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG oslo_db.sqlalchemy.engines [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 05:13:45.481928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writer thread running {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 05:13:45.657392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG passlib.handlers.bcrypt [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 05:13:45.657706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG passlib.handlers.bcrypt [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 05:13:45.716026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:45.717644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:45.841900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 05:13:46.295192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8e56-8f57-4250-9b43-1d3444df93a0 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:46.363187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: INFO dbcounter [None req-841f8e56-8f57-4250-9b43-1d3444df93a0 None None] Registered counter for database keystone Sep 21 05:13:46.385214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG oslo_db.sqlalchemy.engines [None req-841f8e56-8f57-4250-9b43-1d3444df93a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 05:13:46.391217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writer thread running {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 05:13:46.508050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8e56-8f57-4250-9b43-1d3444df93a0 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:46.512313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0754d30-7170-4da2-bf07-1a5d0fb6c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:46.512937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754d30-7170-4da2-bf07-1a5d0fb6c017 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:46.513221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754d30-7170-4da2-bf07-1a5d0fb6c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:46.513493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754d30-7170-4da2-bf07-1a5d0fb6c017 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:46.521499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0754d30-7170-4da2-bf07-1a5d0fb6c017 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:46.573499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0754d30-7170-4da2-bf07-1a5d0fb6c017 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 05:13:46.573781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0754d30-7170-4da2-bf07-1a5d0fb6c017 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:46.587890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 21 05:13:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 05:13:46.593892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:46.610816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7a377-eb65-449a-905f-34e3ccb9294d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:46.615763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85040ec-4def-487e-81ef-4b65583de306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:46.616884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85040ec-4def-487e-81ef-4b65583de306 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:46.617164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85040ec-4def-487e-81ef-4b65583de306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:46.617434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85040ec-4def-487e-81ef-4b65583de306 admin admin] PATH_INFO: `/v3/projects/f856f4ace59d412c839fff1b080f7b3c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:46.618998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85040ec-4def-487e-81ef-4b65583de306 admin admin] RBAC: Authorizing `identity:get_project(project_id=f856f4ace59d412c839fff1b080f7b3c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:46.671415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d85040ec-4def-487e-81ef-4b65583de306 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 05:13:46.671754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85040ec-4def-487e-81ef-4b65583de306 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:46.676183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Sep 21 05:13:46 2022] GET /identity/v3/projects/f856f4ace59d412c839fff1b080f7b3c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:13:48.821513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924846b-ab0f-4c17-9158-8561e6037c2a None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:48.822122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924846b-ab0f-4c17-9158-8561e6037c2a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:48.822122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924846b-ab0f-4c17-9158-8561e6037c2a None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:48.826144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:13:48.831486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692776e-8af3-4529-b5f8-e9d8b1db9fcf None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:48.831924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692776e-8af3-4529-b5f8-e9d8b1db9fcf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:48.832038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692776e-8af3-4529-b5f8-e9d8b1db9fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:48.852610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1692776e-8af3-4529-b5f8-e9d8b1db9fcf None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:48.854112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1692776e-8af3-4529-b5f8-e9d8b1db9fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:48.861929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 05:13:49.140796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924846b-ab0f-4c17-9158-8561e6037c2a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:49.155709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924846b-ab0f-4c17-9158-8561e6037c2a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:49.160347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3b48-47e5-4cca-87b9-c5206aae99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:49.160960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3b48-47e5-4cca-87b9-c5206aae99ea admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:49.161269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3b48-47e5-4cca-87b9-c5206aae99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:49.161547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3b48-47e5-4cca-87b9-c5206aae99ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:49.171153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3b48-47e5-4cca-87b9-c5206aae99ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:49.172966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3b48-47e5-4cca-87b9-c5206aae99ea admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:49.182329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 21 05:13:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:13:49.188102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692776e-8af3-4529-b5f8-e9d8b1db9fcf None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:49.197956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692776e-8af3-4529-b5f8-e9d8b1db9fcf None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:49.210333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035dcf6-11fe-456a-bd18-377a4324ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:49.210963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035dcf6-11fe-456a-bd18-377a4324ce3a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:49.211241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035dcf6-11fe-456a-bd18-377a4324ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:49.211511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035dcf6-11fe-456a-bd18-377a4324ce3a admin admin] PATH_INFO: `/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:49.213246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035dcf6-11fe-456a-bd18-377a4324ce3a admin admin] RBAC: Authorizing `identity:get_user(user_id=c3a7560fcbf84596bbf53086e9d2d4b3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:49.215115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035dcf6-11fe-456a-bd18-377a4324ce3a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:49.216731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Sep 21 05:13:49 2022] GET /identity/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:13:51.429151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dadbe-9679-401d-a29f-8587ddd39cc0 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:51.429656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dadbe-9679-401d-a29f-8587ddd39cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:51.429753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dadbe-9679-401d-a29f-8587ddd39cc0 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:51.431012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:13:51.436138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab735-9742-430a-a8fd-4614b9c97915 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:51.436558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab735-9742-430a-a8fd-4614b9c97915 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:51.436840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab735-9742-430a-a8fd-4614b9c97915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:51.455086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-69bab735-9742-430a-a8fd-4614b9c97915 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:51.456259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-69bab735-9742-430a-a8fd-4614b9c97915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:51.495510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788c8d-3517-4ff5-94d6-dd47a4ac1782 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:51.495791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788c8d-3517-4ff5-94d6-dd47a4ac1782 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:51.496063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788c8d-3517-4ff5-94d6-dd47a4ac1782 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:51.497659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:13:51.503270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:51.503700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:51.504201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:51.538996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:13:51.549393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG passlib.handlers.bcrypt [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81350) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 05:13:51.549792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG passlib.handlers.bcrypt [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81350) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 05:13:51.598944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:51.600575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:51.698594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:13:51.810424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bab735-9742-430a-a8fd-4614b9c97915 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:51.833707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:51.926891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bab735-9742-430a-a8fd-4614b9c97915 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:51.959899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:51.960494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:51.960779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:51.961057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:51.963671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:51.972224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:13:51.981491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:13:51.982591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:13:51.983596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:13:51.988384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:52.065861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b341-5f83-4b6e-b684-a110f4d258a7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:52.068090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:52.068242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:52.087317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87213df1-d5e4-43ac-b4b9-ad459d5e8cfd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:52.105260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:52.106121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:52.106403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:52.106674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:52.120527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:52.121127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:52.121658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:52.121928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:52.122589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:13:52.122890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:52.124325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:52.135658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:13:52.141056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:52.171857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:52.173628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:52.240527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab279b-6e3f-44b9-a802-96c90d4f7bbd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:52.273621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:52.274236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 05:13:52.274378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:52.274529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:52.274781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] PATH_INFO: `/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:52.276038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] RBAC: Authorizing `identity:get_user(user_id=c3a7560fcbf84596bbf53086e9d2d4b3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:52.277554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:52.279129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:13:52 2022] GET /identity/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:13:52.279678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:52.282415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:52.284759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:52.299189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:52.376855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22a3db-d6d0-4736-bfca-5fa6844d7ed3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:52.385663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec2de7-1134-424f-b860-6a72fafb833a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:52.410535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:52.411388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:52.412245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:52.412552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:52.420113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:52.420757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:52.421037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:52.421311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:52.422413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:52.423921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:52.425463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:13:52.430506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:52.431107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:52.431985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:13:52.450375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:13:52.451249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:13:52.452066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:13:52.452066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:13:52.452066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:13:52.452066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:13:52.457295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:52.509998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:52.514528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:52.535526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e4e0-03ce-42ce-97ad-e309f97243d6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:52.565672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462aa6-a1df-4732-a6b5-f930a1cb6cc8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:52.570003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd3ae1-ff0b-4509-920b-c5d7b9fb089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:52.570603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd3ae1-ff0b-4509-920b-c5d7b9fb089e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:52.570881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd3ae1-ff0b-4509-920b-c5d7b9fb089e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:52.571150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd3ae1-ff0b-4509-920b-c5d7b9fb089e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:52.571866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd3ae1-ff0b-4509-920b-c5d7b9fb089e None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.domain.id=default, user.id=c3a7560fcbf84596bbf53086e9d2d4b3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:13:52.572165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd3ae1-ff0b-4509-920b-c5d7b9fb089e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:52.573637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd3ae1-ff0b-4509-920b-c5d7b9fb089e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:52.580337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 21 05:13:52 2022] GET /identity/v3/role_assignments?user.id=c3a7560fcbf84596bbf53086e9d2d4b3&scope.domain.id=default&role.id=7407c800e8af41e2bc429a186be077ba => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:13:52.601324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9662ba-99c8-48ff-a28f-4d51f436a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:52.601966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9662ba-99c8-48ff-a28f-4d51f436a5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:52.602248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9662ba-99c8-48ff-a28f-4d51f436a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:52.602526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9662ba-99c8-48ff-a28f-4d51f436a5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:52.603191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9662ba-99c8-48ff-a28f-4d51f436a5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:13:52.603498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9662ba-99c8-48ff-a28f-4d51f436a5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:52.604974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9662ba-99c8-48ff-a28f-4d51f436a5a3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:52.624488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:13:55.017345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cbeab-6a80-4c02-b4eb-592fb50f2607 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:55.017870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cbeab-6a80-4c02-b4eb-592fb50f2607 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:55.017952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cbeab-6a80-4c02-b4eb-592fb50f2607 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:55.019509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:55.024566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05271059-fa3a-46cc-b254-6c8cb9f401d4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:55.024991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05271059-fa3a-46cc-b254-6c8cb9f401d4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:55.025154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05271059-fa3a-46cc-b254-6c8cb9f401d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:55.053857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-05271059-fa3a-46cc-b254-6c8cb9f401d4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:55.055073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-05271059-fa3a-46cc-b254-6c8cb9f401d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:55.138076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:13:55.472437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20842e-c849-4158-a2b8-2f1c3823886b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:55.473098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20842e-c849-4158-a2b8-2f1c3823886b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:55.473579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20842e-c849-4158-a2b8-2f1c3823886b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:55.475412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:55.480678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6882574-ee88-418b-a777-0ca43a2883e9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:55.481326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6882574-ee88-418b-a777-0ca43a2883e9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:55.481818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6882574-ee88-418b-a777-0ca43a2883e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:55.511273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d6882574-ee88-418b-a777-0ca43a2883e9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:55.512880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d6882574-ee88-418b-a777-0ca43a2883e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:55.582320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:55.611415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 12/25] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:13:55.693552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20842e-c849-4158-a2b8-2f1c3823886b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:55.704375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249de66-8eac-48bc-a67d-e338cc42e888 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:55.704664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249de66-8eac-48bc-a67d-e338cc42e888 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:55.704944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249de66-8eac-48bc-a67d-e338cc42e888 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:55.706448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 13/26] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:55.714126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a08bf-dd36-4376-9e53-5f3337968773 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:55.714415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a08bf-dd36-4376-9e53-5f3337968773 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:55.714695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a08bf-dd36-4376-9e53-5f3337968773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:55.748255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-af4a08bf-dd36-4376-9e53-5f3337968773 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:55.753104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-af4a08bf-dd36-4376-9e53-5f3337968773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:55.889756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:13:55.890121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20842e-c849-4158-a2b8-2f1c3823886b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:55.924611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:55.925496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:55.925916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:55.926356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:55.937858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:13:55.943975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:13:55.945038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:13:55.945969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:13:55.947857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 14/28] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:13:55.953971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a08bf-dd36-4376-9e53-5f3337968773 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:55.974286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:55.979504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:56.124924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a08bf-dd36-4376-9e53-5f3337968773 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.136534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:56.138065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b5e5-4b38-4157-a8f0-d3def39dba94 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.185868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f074be-4dde-4c9b-9111-90bebd2a11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.186735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f074be-4dde-4c9b-9111-90bebd2a11ef None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.187170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f074be-4dde-4c9b-9111-90bebd2a11ef None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.187585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f074be-4dde-4c9b-9111-90bebd2a11ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.193241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8230d36-6ffa-4921-832a-634b9b1127d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.193861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230d36-6ffa-4921-832a-634b9b1127d6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.194145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230d36-6ffa-4921-832a-634b9b1127d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.194421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230d36-6ffa-4921-832a-634b9b1127d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.195153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8230d36-6ffa-4921-832a-634b9b1127d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:13:56.195465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8230d36-6ffa-4921-832a-634b9b1127d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.196899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8230d36-6ffa-4921-832a-634b9b1127d6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.205399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f074be-4dde-4c9b-9111-90bebd2a11ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.209845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f074be-4dde-4c9b-9111-90bebd2a11ef None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.223618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 15/29] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:13:56.225747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a921f8-eb92-4304-b064-816d346e34c6 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.226175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a921f8-eb92-4304-b064-816d346e34c6 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.226589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a921f8-eb92-4304-b064-816d346e34c6 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.227919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-43f074be-4dde-4c9b-9111-90bebd2a11ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:13:56.230202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:13:56.231236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:13:56.232160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:13:56.232160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:13:56.232160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:13:56.233719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a921f8-eb92-4304-b064-816d346e34c6 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:56.233881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 15/31] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:13:56.235344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373ed0-8b8b-4313-a48e-640ad5b6de6f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.235773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373ed0-8b8b-4313-a48e-640ad5b6de6f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.236224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373ed0-8b8b-4313-a48e-640ad5b6de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.269433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a9373ed0-8b8b-4313-a48e-640ad5b6de6f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:56.270873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a9373ed0-8b8b-4313-a48e-640ad5b6de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:56.375277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:56.398886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 16/32] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:13:56.399888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9373ed0-8b8b-4313-a48e-640ad5b6de6f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:56.405027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a921f8-eb92-4304-b064-816d346e34c6 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.445280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.446277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.446763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.447225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] PATH_INFO: `/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.448935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a7560fcbf84596bbf53086e9d2d4b3)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.450598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.452387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:13:56 2022] GET /identity/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3 => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:13:56.453338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:56.488770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:56.556153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9373ed0-8b8b-4313-a48e-640ad5b6de6f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.559135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3714276-2e13-4427-9631-8f0039d6a155 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.592335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.592951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.593231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.593505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.594149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:13:56.594450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.595222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99f858-f078-4acc-b26d-a460b323be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.595835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f858-f078-4acc-b26d-a460b323be06 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.595927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.596116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f858-f078-4acc-b26d-a460b323be06 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.596417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f858-f078-4acc-b26d-a460b323be06 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.597084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99f858-f078-4acc-b26d-a460b323be06 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.598572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99f858-f078-4acc-b26d-a460b323be06 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.615667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 17/34] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:13:56.616768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:56.670091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:56.725454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ffcd7-25c4-4c0e-a466-5bf1a7d41508 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.735648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 18/35] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 05:13:56 2022] POST /identity/v3/roles => generated 219 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:13:56.736995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322b82-abd5-493d-b1c1-3eb0aa2340a9 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.737290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322b82-abd5-493d-b1c1-3eb0aa2340a9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.737565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322b82-abd5-493d-b1c1-3eb0aa2340a9 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.738809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:56.744891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322b82-abd5-493d-b1c1-3eb0aa2340a9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:56.774842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.775849 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.776468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.776959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.778418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.780097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.782033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 18/37] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:13:56.783065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:56.870818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:56.880124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322b82-abd5-493d-b1c1-3eb0aa2340a9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.900245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364e8ff-5d77-4ee6-a768-e51cd6d9f6ec None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:56.916730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:56.926407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07448cb-a86c-43aa-a9e0-e38b337ab0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.927910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07448cb-a86c-43aa-a9e0-e38b337ab0c5 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.928430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07448cb-a86c-43aa-a9e0-e38b337ab0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.928838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07448cb-a86c-43aa-a9e0-e38b337ab0c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.930321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07448cb-a86c-43aa-a9e0-e38b337ab0c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.932385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07448cb-a86c-43aa-a9e0-e38b337ab0c5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.940754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92da99-fc3e-48ac-b2b5-9919b620a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:56.941488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92da99-fc3e-48ac-b2b5-9919b620a695 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.941773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92da99-fc3e-48ac-b2b5-9919b620a695 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.942046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92da99-fc3e-48ac-b2b5-9919b620a695 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.942748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92da99-fc3e-48ac-b2b5-9919b620a695 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:56.944143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92da99-fc3e-48ac-b2b5-9919b620a695 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:56.964148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:13:56 2022] POST /identity/v3/projects => generated 301 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:13:56.965688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d5ff-33a4-4b66-a47e-23c946aaf9fd None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:56.965981 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d5ff-33a4-4b66-a47e-23c946aaf9fd None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:56.966554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d5ff-33a4-4b66-a47e-23c946aaf9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:56.987141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-99c1d5ff-33a4-4b66-a47e-23c946aaf9fd None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:56.989530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-99c1d5ff-33a4-4b66-a47e-23c946aaf9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:57.066572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 21/39] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:13:57.069923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d5ff-33a4-4b66-a47e-23c946aaf9fd None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:57.076822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 19/40] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 05:13:56 2022] POST /identity/v3/roles => generated 225 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:13:57.078572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2996b-cedd-4122-ba40-07ab7c2a782c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:57.078867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2996b-cedd-4122-ba40-07ab7c2a782c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:57.079142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2996b-cedd-4122-ba40-07ab7c2a782c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:57.081885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 20/41] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:57.086997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c16508-a74c-440e-afe7-a5c64a1d6bd2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:57.087292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c16508-a74c-440e-afe7-a5c64a1d6bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:57.087547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c16508-a74c-440e-afe7-a5c64a1d6bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:57.133436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-46c16508-a74c-440e-afe7-a5c64a1d6bd2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:57.135026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-46c16508-a74c-440e-afe7-a5c64a1d6bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:57.181902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:57.217995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d5ff-33a4-4b66-a47e-23c946aaf9fd None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:57.251648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:13:57.263301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:57.264122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:57.264557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:57.264894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] PATH_INFO: `/v3/domains/default/users/c3a7560fcbf84596bbf53086e9d2d4b3/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:57.267219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c3a7560fcbf84596bbf53086e9d2d4b3, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:57.268886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:57.291458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 22/43] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Sep 21 05:13:57 2022] PUT /identity/v3/domains/default/users/c3a7560fcbf84596bbf53086e9d2d4b3/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:13:57.385433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c16508-a74c-440e-afe7-a5c64a1d6bd2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:57.495000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c16508-a74c-440e-afe7-a5c64a1d6bd2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:57.498116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:57.549876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:57.637883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:57.638505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:57.638786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:57.639058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:57.639735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:57.641293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:57.656189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 05:13:57 2022] POST /identity/v3/roles => generated 223 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:13:57.664023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01981be1-6d36-4a13-bcdd-c83d85728a30 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:57.702816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53546330-e51b-41d8-8508-424f04a8fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:57.703523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546330-e51b-41d8-8508-424f04a8fa90 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:57.703812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546330-e51b-41d8-8508-424f04a8fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:57.704088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546330-e51b-41d8-8508-424f04a8fa90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:57.705278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53546330-e51b-41d8-8508-424f04a8fa90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:57.706783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53546330-e51b-41d8-8508-424f04a8fa90 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:57.708767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 23/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:13:57.714411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:57.825562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d759e8e-a903-4658-87b8-01bfa288ba08 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:57.865217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb53eb3-b396-4f9d-a104-cfd838c5eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:57.865840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53eb3-b396-4f9d-a104-cfd838c5eca4 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:57.866113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53eb3-b396-4f9d-a104-cfd838c5eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:57.866404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53eb3-b396-4f9d-a104-cfd838c5eca4 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:57.867047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb53eb3-b396-4f9d-a104-cfd838c5eca4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:13:57.868525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb53eb3-b396-4f9d-a104-cfd838c5eca4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:13:57.898877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:13:57 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:13:59.496191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029cd2d-fdf0-403a-a083-c3add41e68ed None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:59.496979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029cd2d-fdf0-403a-a083-c3add41e68ed None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:59.497058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029cd2d-fdf0-403a-a083-c3add41e68ed None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:59.498357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:13:59.503658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e35e-e2d5-4407-b72a-45daa1fb5bea None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:59.504056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e35e-e2d5-4407-b72a-45daa1fb5bea None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:59.504213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e35e-e2d5-4407-b72a-45daa1fb5bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:13:59.522986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a090e35e-e2d5-4407-b72a-45daa1fb5bea None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:13:59.524164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a090e35e-e2d5-4407-b72a-45daa1fb5bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:13:59.534833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:59.591121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:13:59.860878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029cd2d-fdf0-403a-a083-c3add41e68ed None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:13:59.870103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:13:59.965652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029cd2d-fdf0-403a-a083-c3add41e68ed None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:13:59.997320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b738c-2141-47a5-a192-76fe6c7ab80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:13:59.997945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b738c-2141-47a5-a192-76fe6c7ab80d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:13:59.998224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b738c-2141-47a5-a192-76fe6c7ab80d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:13:59.998498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b738c-2141-47a5-a192-76fe6c7ab80d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.010232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b738c-2141-47a5-a192-76fe6c7ab80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-107b738c-2141-47a5-a192-76fe6c7ab80d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:00.016094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:00.016966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:00.017871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:13:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:00.023616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090e35e-e2d5-4407-b72a-45daa1fb5bea None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:00.032890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9598cac-bcf6-45d4-9ce1-d67a6f15701c None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.033183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9598cac-bcf6-45d4-9ce1-d67a6f15701c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.033462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9598cac-bcf6-45d4-9ce1-d67a6f15701c None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.034937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 26/50] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:00.039587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1246852-0b58-4524-9c1c-f1eb2016f9f8 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.039878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1246852-0b58-4524-9c1c-f1eb2016f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.040156 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1246852-0b58-4524-9c1c-f1eb2016f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.058548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a1246852-0b58-4524-9c1c-f1eb2016f9f8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:00.059728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a1246852-0b58-4524-9c1c-f1eb2016f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:00.117200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:00.122340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090e35e-e2d5-4407-b72a-45daa1fb5bea None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:00.126312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 27/51] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:00.158019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:00.158630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.158909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.159182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.159834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:00.160138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:00.161595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:00.169479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:00.175373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1246852-0b58-4524-9c1c-f1eb2016f9f8 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:00.269815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1246852-0b58-4524-9c1c-f1eb2016f9f8 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:00.303647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:00.304257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.304569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.304844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] PATH_INFO: `/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.305951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] RBAC: Authorizing `identity:get_user(user_id=c3a7560fcbf84596bbf53086e9d2d4b3)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:00.307389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:00.308949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 28/53] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:00 2022] GET /identity/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:00.314314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:00.325976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:00.391034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:00.412248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eb12b-f4e2-452b-9587-ea8c7c3efb0c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:00.447702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:00.448398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.448683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.448956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.450155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:00.451659 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:00.453354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 26/54] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:00.459444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:00.540655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:00.557848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:00.565528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aba65-0308-46e1-aae4-a8715c5f61df None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:00.595821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4758e3-0a06-4dd3-b9c6-aba27dbd290a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:00.599950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:00.600576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.600862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.601138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.601858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.domain.id=default, user.id=c3a7560fcbf84596bbf53086e9d2d4b3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:00.602166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:00.603625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:00.609429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 21 05:14:00 2022] GET /identity/v3/role_assignments?user.id=c3a7560fcbf84596bbf53086e9d2d4b3&scope.domain.id=default&role.id=7407c800e8af41e2bc429a186be077ba => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:00.630216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89030d-f0ab-486b-9290-1a0d9aeb4505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:00.630880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89030d-f0ab-486b-9290-1a0d9aeb4505 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.631166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89030d-f0ab-486b-9290-1a0d9aeb4505 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.631446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89030d-f0ab-486b-9290-1a0d9aeb4505 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.632675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89030d-f0ab-486b-9290-1a0d9aeb4505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:00.634183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89030d-f0ab-486b-9290-1a0d9aeb4505 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:00.635848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:00.641954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:00.748349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167978b3-7732-49f1-b2de-b0343ecedab8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:00.788548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd108775-9d95-42bf-ab6d-62aaf21770c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:00.789173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd108775-9d95-42bf-ab6d-62aaf21770c9 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:00.789454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd108775-9d95-42bf-ab6d-62aaf21770c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:00.789728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd108775-9d95-42bf-ab6d-62aaf21770c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:00.790386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd108775-9d95-42bf-ab6d-62aaf21770c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:00.791836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd108775-9d95-42bf-ab6d-62aaf21770c9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:00.803981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:00.820855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 28/57] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 21 05:14:00 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:02.952755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff956be-81e6-4d44-9a08-7b88a022b07e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:02.953241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff956be-81e6-4d44-9a08-7b88a022b07e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:02.953322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff956be-81e6-4d44-9a08-7b88a022b07e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:02.954639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:02.959689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba5fda-455d-48a3-a93b-2d82f93ae873 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:02.960066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba5fda-455d-48a3-a93b-2d82f93ae873 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:02.960246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba5fda-455d-48a3-a93b-2d82f93ae873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:02.978309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-12ba5fda-455d-48a3-a93b-2d82f93ae873 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:02.979474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-12ba5fda-455d-48a3-a93b-2d82f93ae873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:03.043491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:03.312617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff956be-81e6-4d44-9a08-7b88a022b07e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:03.409477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff956be-81e6-4d44-9a08-7b88a022b07e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:03.436948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:03.442252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05574cd4-c2ce-460f-bce0-1f44fec50444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:03.442873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574cd4-c2ce-460f-bce0-1f44fec50444 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:03.443157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574cd4-c2ce-460f-bce0-1f44fec50444 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:03.443434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574cd4-c2ce-460f-bce0-1f44fec50444 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:03.444578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05574cd4-c2ce-460f-bce0-1f44fec50444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:03.446021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05574cd4-c2ce-460f-bce0-1f44fec50444 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:03.447560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:03.452888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba5fda-455d-48a3-a93b-2d82f93ae873 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:03.548585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba5fda-455d-48a3-a93b-2d82f93ae873 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:03.572351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:03.584843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ec34-8bd4-47bd-b9e1-aa6a2047ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:03.585446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ec34-8bd4-47bd-b9e1-aa6a2047ecd1 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:03.585729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ec34-8bd4-47bd-b9e1-aa6a2047ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:03.586002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ec34-8bd4-47bd-b9e1-aa6a2047ecd1 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:03.586654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52ec34-8bd4-47bd-b9e1-aa6a2047ecd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:03.588096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52ec34-8bd4-47bd-b9e1-aa6a2047ecd1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:03.613301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:14:03 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:06.948312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e171e-d620-4f72-86c2-8c04bdc98ae1 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:06.948811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e171e-d620-4f72-86c2-8c04bdc98ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:06.948913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e171e-d620-4f72-86c2-8c04bdc98ae1 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:06.950230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:06.955677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78792-d124-4dce-9d11-c88218d26dc3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:06.956485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78792-d124-4dce-9d11-c88218d26dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:06.956898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78792-d124-4dce-9d11-c88218d26dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:06.969868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c8c1-ab1c-47eb-8c5c-25b17f822ec7 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:06.970202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c8c1-ab1c-47eb-8c5c-25b17f822ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:06.970452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c8c1-ab1c-47eb-8c5c-25b17f822ec7 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:06.971798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 33/63] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:06.981419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da708-0f02-48f2-95c2-73f9d91db347 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:06.982026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da708-0f02-48f2-95c2-73f9d91db347 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:06.982525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da708-0f02-48f2-95c2-73f9d91db347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:06.983854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-62c78792-d124-4dce-9d11-c88218d26dc3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:06.985081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-62c78792-d124-4dce-9d11-c88218d26dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:07.015262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d82da708-0f02-48f2-95c2-73f9d91db347 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:07.016495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d82da708-0f02-48f2-95c2-73f9d91db347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:07.130041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 31/64] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:07.154689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 34/65] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:07.241162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bac83-ea9e-4c13-9400-7101bdfaa131 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.241471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bac83-ea9e-4c13-9400-7101bdfaa131 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.241718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bac83-ea9e-4c13-9400-7101bdfaa131 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.243088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 32/66] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:07.248708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166cd9-b9ef-494c-ab4b-dc4474329e75 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.248999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166cd9-b9ef-494c-ab4b-dc4474329e75 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.249280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166cd9-b9ef-494c-ab4b-dc4474329e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.267888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-42166cd9-b9ef-494c-ab4b-dc4474329e75 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:07.269425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-42166cd9-b9ef-494c-ab4b-dc4474329e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:07.360567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:07.414288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bac83-ea9e-4c13-9400-7101bdfaa131 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:07.466957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec6a5-d932-4560-bc4f-6d5f3b3a84cd None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.467577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec6a5-d932-4560-bc4f-6d5f3b3a84cd None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.468088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec6a5-d932-4560-bc4f-6d5f3b3a84cd None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.469802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 36/68] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:07.475096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2fd35-7b1b-49dc-9c59-b277c3b8281f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.475733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2fd35-7b1b-49dc-9c59-b277c3b8281f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.476209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2fd35-7b1b-49dc-9c59-b277c3b8281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.497837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4fe2fd35-7b1b-49dc-9c59-b277c3b8281f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:07.499503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4fe2fd35-7b1b-49dc-9c59-b277c3b8281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:07.568543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:07.575071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bac83-ea9e-4c13-9400-7101bdfaa131 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:07.582948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 37/69] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:07.582948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18fd2-5be9-46bf-80ff-6b8b07b10a28 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.582948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18fd2-5be9-46bf-80ff-6b8b07b10a28 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.582948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18fd2-5be9-46bf-80ff-6b8b07b10a28 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.582948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 38/70] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:07.584359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18fd2-5be9-46bf-80ff-6b8b07b10a28 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:07.590570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:07.627839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc4ecb-8048-477c-8f52-0c9c5d402809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:07.628509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4ecb-8048-477c-8f52-0c9c5d402809 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.628791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4ecb-8048-477c-8f52-0c9c5d402809 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.629065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4ecb-8048-477c-8f52-0c9c5d402809 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.642224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc4ecb-8048-477c-8f52-0c9c5d402809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e2fc4ecb-8048-477c-8f52-0c9c5d402809 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:07.647930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:07.648767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:07.649510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:07.651738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 33/71] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:07.653196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bf13-0c02-4897-95d0-4d313cf12b4c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.653689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bf13-0c02-4897-95d0-4d313cf12b4c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.654151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bf13-0c02-4897-95d0-4d313cf12b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.674955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3d83bf13-0c02-4897-95d0-4d313cf12b4c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:07.676121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3d83bf13-0c02-4897-95d0-4d313cf12b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:07.715309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18fd2-5be9-46bf-80ff-6b8b07b10a28 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:07.752749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:07.753705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.754197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.754678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.755732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 34/72] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:07.756765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bf13-0c02-4897-95d0-4d313cf12b4c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:07.775978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:07.781777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:07.782630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:07.783378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:07.785801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 39/73] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:07.788238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:07.844316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:07.884944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:07.889762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bf13-0c02-4897-95d0-4d313cf12b4c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:07.906026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a583bd3-0130-4d5e-8679-1a20591573f4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:07.929084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:07.929627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.929913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.930191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.930855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:07.931170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:07.932615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:07.943998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 35/74] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:07.945169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:07.949613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:07.950074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:07.950252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:07.950525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:07.967166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:07.976455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:07.977379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:07.978134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 40/75] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:07.984809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.067106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245c45-54ea-418c-ab9c-167778be3948 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.089561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed7e2e-6615-4566-aaf1-03bb11c412ab None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.100245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.100738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.101359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.101639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.101930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.102710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:08.103018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.104542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.112555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 36/76] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:08.113445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.128300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.129162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.129452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.129730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.131487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.133008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.134563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 41/77] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:08.135325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.141931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.217230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b44e-b5e4-4bed-aa6a-6d98afbef94a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.234140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9d311-c54a-44ee-8eca-78ed7ed6af28 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.250232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.250865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.251152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.251427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.264305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.265815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.267408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 37/78] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:08.267754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.268172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.268397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.268682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.268960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.269621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:08.269926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.272185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.280409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 42/79] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:08.281237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.326424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.356807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.376467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743b98d-52ff-4b76-a3a7-9dc8d31892be None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.387685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5882-8724-422c-99d0-8e32545c0750 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.410343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.410973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.411773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.412051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.420890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.421528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.421812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.421975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:08.422076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] PATH_INFO: `/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.423225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] RBAC: Authorizing `identity:get_user(user_id=c3a7560fcbf84596bbf53086e9d2d4b3)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.424720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.426309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 43/80] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:08.426748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:08.428339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:08.429101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:08.429678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.429742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 38/81] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:08.429742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.525134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf46d-0bf0-4baa-af00-e6e15889270a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.525755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1682-cb1a-4e4a-a464-03b5d5e654a3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.533612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.559527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.559741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.560129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.560370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.560462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.560656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.560744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.560932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.561432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.562913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.571089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.589935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 44/82] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:14:08 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:08.590745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.641587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.643139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.708841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cdc88-5786-420f-b4b2-bb5675d244c6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.748581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.749240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.749544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.749806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.751007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.752520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.754173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 45/83] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:08.755015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.763634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 39/84] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:08.768969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:08.790531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.820507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:08.873041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e02c04-7263-490a-a1b2-27ad4ca1b91b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.901940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23b6c-01b8-455e-b289-e87f7c33c9f2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:08.918428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.919442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.919910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.920190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.942239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:08.943400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:08.943683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:08.943955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:08.944651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:08.944954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:08.946344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:08.957013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 40/85] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:08.957826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.003090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.004596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.035918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:09.076092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98162993-da62-4f03-9725-2761f18cc57d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.078466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:09.115728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.116769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.117301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 46/86] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:09.122423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.122663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.123258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.198779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.200848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.235252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836192-c8f8-4b9f-8d26-7a930e8c81ec None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.268454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:09.276382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.277614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.278315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.278798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.280144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.281814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.283673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 47/87] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:09.284838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.326938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 41/88] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:09.327809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.330062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:09.402526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711655-3f9f-4698-8ffb-eca4d5beec94 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.441172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.442165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.443193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.443664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.445044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.446877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.449341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 48/89] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:09.450322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.462678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736476b8-07d4-45c1-a36a-ed842d080812 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.508663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.509349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.509640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.509926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.511083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.513032 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.519903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 42/90] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:09.519903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.532130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:09.576427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e3590-61ea-4deb-b391-6e6ad0ae1019 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.599993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:09.620662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.621304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.621590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.622123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.622884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=1c081f9eab664b059dac8390c8aac361) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:09.623203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.624896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.635079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 49/91] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/role_assignments?user.id=1c081f9eab664b059dac8390c8aac361&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=75d345ed873a4df3be5afc217fb2676f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:09.636328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.639002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5c724-6148-4e26-b58b-51896e896008 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.681831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.682897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.683373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.683860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.685204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.687031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.689212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 43/92] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:09.690331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.759741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a351de-c7d4-422e-bdd3-4f2fd9398c4e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.796905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:09.811603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.812550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.812997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.813436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.869888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb428-4378-47a0-ba2c-00940ab035f7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:09.916017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.917761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.944860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:09.945484 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:09.945770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:09.946047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:09.946788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=c3a7560fcbf84596bbf53086e9d2d4b3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:09.947100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:09.948595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:09.957137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 44/93] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/role_assignments?user.id=c3a7560fcbf84596bbf53086e9d2d4b3&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:09.957946 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:09.966995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:10.039249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 50/94] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:10.045437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:10.118108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0e66f-4537-40ff-be0d-73696d153ba7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:10.142045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:10.178730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:10.179564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:10.179853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:10.180531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:10.181278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] RBAC: Adding query filter params (role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=1c081f9eab664b059dac8390c8aac361) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:10.181593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:10.183069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:10.189869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 45/95] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:09 2022] GET /identity/v3/role_assignments?user.id=1c081f9eab664b059dac8390c8aac361&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:10.286176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221f020-f57c-4c53-b6b4-88ef6d0a9db6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:10.331862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09b9e4-f417-4d91-9a72-8483660e2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:10.332549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b9e4-f417-4d91-9a72-8483660e2e14 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:10.332839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b9e4-f417-4d91-9a72-8483660e2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:10.333166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b9e4-f417-4d91-9a72-8483660e2e14 None admin] PATH_INFO: `/v3/projects/703d86004dbf411d9b022d635288f71b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:10.334333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09b9e4-f417-4d91-9a72-8483660e2e14 None admin] RBAC: Authorizing `identity:get_project(project_id=703d86004dbf411d9b022d635288f71b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:10.335835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09b9e4-f417-4d91-9a72-8483660e2e14 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:10.337922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 51/96] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:10 2022] GET /identity/v3/projects/703d86004dbf411d9b022d635288f71b => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:10.343945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:10.424792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:10.472947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45595ec9-c6b2-470d-b1c5-e8a542925811 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:10.518164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaa2c7-86d0-4183-9d86-0cc091cf9a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:10.518786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa2c7-86d0-4183-9d86-0cc091cf9a87 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:10.519074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa2c7-86d0-4183-9d86-0cc091cf9a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:10.519355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa2c7-86d0-4183-9d86-0cc091cf9a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:10.520093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaa2c7-86d0-4183-9d86-0cc091cf9a87 None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=703d86004dbf411d9b022d635288f71b, user.id=1c081f9eab664b059dac8390c8aac361) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:10.520438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaa2c7-86d0-4183-9d86-0cc091cf9a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:10.521978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaa2c7-86d0-4183-9d86-0cc091cf9a87 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:10.531505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:10 2022] GET /identity/v3/role_assignments?user.id=1c081f9eab664b059dac8390c8aac361&scope.project.id=703d86004dbf411d9b022d635288f71b&role.id=75d345ed873a4df3be5afc217fb2676f => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:11.042263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf99f86-ba5b-42ed-a74b-45afe537374f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:11.043278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf99f86-ba5b-42ed-a74b-45afe537374f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:11.043758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf99f86-ba5b-42ed-a74b-45afe537374f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:11.045349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 52/98] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:11.050779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46281cd-1887-4b18-abe4-4230314e1873 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:11.051288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46281cd-1887-4b18-abe4-4230314e1873 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:11.051796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46281cd-1887-4b18-abe4-4230314e1873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:11.070454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e46281cd-1887-4b18-abe4-4230314e1873 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:11.071950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e46281cd-1887-4b18-abe4-4230314e1873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:11.146104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 47/99] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:11.698338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf99f86-ba5b-42ed-a74b-45afe537374f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:11.824423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:11.828655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf99f86-ba5b-42ed-a74b-45afe537374f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:11.876378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:11.876717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe00c9-3517-45ce-9637-d30d02effd72 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:11.877257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe00c9-3517-45ce-9637-d30d02effd72 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:11.877372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:11.877660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:11.877942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:11.878230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe00c9-3517-45ce-9637-d30d02effd72 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:11.879755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 48/100] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:11.893609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2776094-5f2a-4748-ba8d-e286eceaf3e9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:11.894058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:11.894362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2776094-5f2a-4748-ba8d-e286eceaf3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:11.894827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2776094-5f2a-4748-ba8d-e286eceaf3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:11.899049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:11.899914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:11.900698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 53/101] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:11.905849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:11.929503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e2776094-5f2a-4748-ba8d-e286eceaf3e9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:11.931014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e2776094-5f2a-4748-ba8d-e286eceaf3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:12.055057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:12.076663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 49/102] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:12.080473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9ca4-fd0a-4616-b1ff-7dbae2987004 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:12.146082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:12.146696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:12.146978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:12.147254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:12.147921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:12.148225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:12.149646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:12.164130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 54/103] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:12.169923 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2776094-5f2a-4748-ba8d-e286eceaf3e9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:12.313181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2776094-5f2a-4748-ba8d-e286eceaf3e9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:12.360430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:12.361436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:12.361915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:12.362412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] PATH_INFO: `/v3/users/5b273dda053844d6b3ead9b894c6917a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:12.381000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] RBAC: Authorizing `identity:get_user(user_id=5b273dda053844d6b3ead9b894c6917a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:12.382554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:12.384348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 50/104] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:12 2022] GET /identity/v3/users/5b273dda053844d6b3ead9b894c6917a => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:12.393386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:12.417048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:12.438110 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:12.507061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:12.556116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb942b0-1aeb-4fff-920e-3171401ee8b4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:12.602412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf7155-61c4-45e3-9ab0-45f450b89b67 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:12.623322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b272-78f4-48b4-be2a-063c4398cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:12.623951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b272-78f4-48b4-be2a-063c4398cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:12.624239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b272-78f4-48b4-be2a-063c4398cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:12.624583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b272-78f4-48b4-be2a-063c4398cdd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:12.671930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b16a8d-87a3-4192-a43e-fb1addc9af42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:12.673031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16a8d-87a3-4192-a43e-fb1addc9af42 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:12.674191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16a8d-87a3-4192-a43e-fb1addc9af42 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:12.675210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16a8d-87a3-4192-a43e-fb1addc9af42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:12.678082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b16a8d-87a3-4192-a43e-fb1addc9af42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:12.679689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b16a8d-87a3-4192-a43e-fb1addc9af42 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:12.682726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 51/105] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:12.684824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70d0d-ae81-45db-9695-6d33d099fcdd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:12.687295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70d0d-ae81-45db-9695-6d33d099fcdd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:12.688557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70d0d-ae81-45db-9695-6d33d099fcdd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:12.693197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 52/106] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:12.694124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70d0d-ae81-45db-9695-6d33d099fcdd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:12.755081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b272-78f4-48b4-be2a-063c4398cdd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:12.757017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b272-78f4-48b4-be2a-063c4398cdd8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:12.804999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:12.902250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70d0d-ae81-45db-9695-6d33d099fcdd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:12.931179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:12.958246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:12.959534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca088-5d59-44c6-bd13-c741f40897a2 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:12.959826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca088-5d59-44c6-bd13-c741f40897a2 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:12.960103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca088-5d59-44c6-bd13-c741f40897a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:12.967854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:12.968498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:12.968784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:12.969061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:12.969714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:12.971165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:12.997681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-653ca088-5d59-44c6-bd13-c741f40897a2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:12.998898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-653ca088-5d59-44c6-bd13-c741f40897a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:13.029792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 53/108] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:14:12 2022] POST /identity/v3/projects => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:13.030726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:13.118082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 56/109] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:13.219595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0567077-52a6-48cc-8ae2-a45ee06f6c50 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:13.271082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd13f9-cb44-4155-a101-a425e3422ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:13.271753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd13f9-cb44-4155-a101-a425e3422ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.272053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd13f9-cb44-4155-a101-a425e3422ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.272333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd13f9-cb44-4155-a101-a425e3422ae8 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.273899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd13f9-cb44-4155-a101-a425e3422ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:13.275534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd13f9-cb44-4155-a101-a425e3422ae8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:13.277288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 54/110] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:13 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:13.284067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ca088-5d59-44c6-bd13-c741f40897a2 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:13.365391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:13.381174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed116d-756b-4f7b-935b-b727c9ad7cbe None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.381483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed116d-756b-4f7b-935b-b727c9ad7cbe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.381661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed116d-756b-4f7b-935b-b727c9ad7cbe None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.383022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 55/111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:13.388159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4a64-3c72-4f0d-aa1b-044422daeeb4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.388480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4a64-3c72-4f0d-aa1b-044422daeeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.388761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4a64-3c72-4f0d-aa1b-044422daeeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.429605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ad1b4a64-3c72-4f0d-aa1b-044422daeeb4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:13.430930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ad1b4a64-3c72-4f0d-aa1b-044422daeeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:13.436417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ca088-5d59-44c6-bd13-c741f40897a2 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:13.478725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:13.484067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0208f-8333-4fe2-bf0c-bf4b1cb2ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:13.484713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0208f-8333-4fe2-bf0c-bf4b1cb2ea95 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.484996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0208f-8333-4fe2-bf0c-bf4b1cb2ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.485270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0208f-8333-4fe2-bf0c-bf4b1cb2ea95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.486000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0208f-8333-4fe2-bf0c-bf4b1cb2ea95 None admin] RBAC: Adding query filter params (role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=5b273dda053844d6b3ead9b894c6917a) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:13.486321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0208f-8333-4fe2-bf0c-bf4b1cb2ea95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:13.487787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0208f-8333-4fe2-bf0c-bf4b1cb2ea95 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:13.499533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 57/112] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:13 2022] GET /identity/v3/role_assignments?user.id=5b273dda053844d6b3ead9b894c6917a&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:13.546704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 56/113] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 21 05:14:13.552417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94513229-cd08-4e71-903b-b53d8d6b61ef None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.552738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94513229-cd08-4e71-903b-b53d8d6b61ef None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.552977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94513229-cd08-4e71-903b-b53d8d6b61ef None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.554874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 58/114] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:13.561065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a41fc-5852-4937-b2b8-b6a442e23e6b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.561733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a41fc-5852-4937-b2b8-b6a442e23e6b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.562238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a41fc-5852-4937-b2b8-b6a442e23e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.580625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94513229-cd08-4e71-903b-b53d8d6b61ef None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:13.583750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c96a41fc-5852-4937-b2b8-b6a442e23e6b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:13.585282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c96a41fc-5852-4937-b2b8-b6a442e23e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:13.671665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 57/115] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:13.746190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94513229-cd08-4e71-903b-b53d8d6b61ef None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:13.768452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:13.792802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:13.793832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.794314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.794854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.809587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:13.816769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:13.818203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:13.818983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:13.821382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 59/116] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:14:13.827439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a41fc-5852-4937-b2b8-b6a442e23e6b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:13.943904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:13.947161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:13.951855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a41fc-5852-4937-b2b8-b6a442e23e6b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:13.988189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:13.988845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:13.989132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:13.989995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:13.990677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:13.991035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:13.992482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:14.007336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 58/117] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:14.016019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:14.128612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df48cf-c16f-476b-b52f-5a9091fa7959 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:14.143116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23421-db00-4de9-b696-1882295f65c6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:14.175824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118459e3-ff3c-4c07-84ab-a24ae6265966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:14.176497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118459e3-ff3c-4c07-84ab-a24ae6265966 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.177353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118459e3-ff3c-4c07-84ab-a24ae6265966 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.177639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118459e3-ff3c-4c07-84ab-a24ae6265966 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.180585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:14.181476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.181953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.182419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.183815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:14.185602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:14.187487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 59/118] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:14 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:14.188481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:14.194428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118459e3-ff3c-4c07-84ab-a24ae6265966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-118459e3-ff3c-4c07-84ab-a24ae6265966 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:14.199727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:14.200632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:14.201400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 60/119] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:14.202048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6721-1182-4042-9b03-892f2de61001 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.202830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6721-1182-4042-9b03-892f2de61001 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.202830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6721-1182-4042-9b03-892f2de61001 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.203969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 61/120] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:14.209190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa6721-1182-4042-9b03-892f2de61001 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:14.236723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:14.257774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:14.309004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84415a-9981-46f6-92e5-b2debe794f12 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:14.343281 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f737cf-3f89-44f8-87d6-cf013041a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:14.344251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f737cf-3f89-44f8-87d6-cf013041a06b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.344810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f737cf-3f89-44f8-87d6-cf013041a06b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.345282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f737cf-3f89-44f8-87d6-cf013041a06b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.347870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa6721-1182-4042-9b03-892f2de61001 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:14.363255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f737cf-3f89-44f8-87d6-cf013041a06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-97f737cf-3f89-44f8-87d6-cf013041a06b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:14.370934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:14.372047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:14.372862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 60/121] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:14.373487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287ff2-c7b7-4c4b-9e91-d6ccd1cc0da0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.374292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287ff2-c7b7-4c4b-9e91-d6ccd1cc0da0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.374292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287ff2-c7b7-4c4b-9e91-d6ccd1cc0da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.396116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c6287ff2-c7b7-4c4b-9e91-d6ccd1cc0da0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:14.397703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c6287ff2-c7b7-4c4b-9e91-d6ccd1cc0da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:14.402874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:14.403525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.403811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.404086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.405285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:14.406759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:14.409210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 62/122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:14 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:14.409828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:14.478200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 61/123] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:14.484310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287ff2-c7b7-4c4b-9e91-d6ccd1cc0da0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:14.518973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:14.542421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24019-4a2b-473a-b072-f700cbcbe69e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:14.545260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:14.582756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:14.584262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.584716 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.585133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.586121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:14.586586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:14.588264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:14.599996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 63/124] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:14.601214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:14.713029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287ff2-c7b7-4c4b-9e91-d6ccd1cc0da0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:14.716756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f170e-6f13-408b-81a4-fa650ce87d09 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:14.755628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:14.756609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.757263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.757733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/1c081f9eab664b059dac8390c8aac361/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.759876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] RBAC: Authorizing `identity:create_grant(project_id=3a55b29c3502461cb780f9a3ce844b88, user_id=1c081f9eab664b059dac8390c8aac361, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:14.761846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:14.781240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 64/125] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:14 2022] PUT /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/1c081f9eab664b059dac8390c8aac361/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:14.788925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:14.795991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:14.803981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:14.804604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:14.804895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:14.805586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:14.805894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:14.807344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:14.835894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 62/126] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:14.838946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:14.851778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.001860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe19f0-189c-444a-881c-d38726112adf None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.022149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:15.055689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99676f-d4af-4bbb-a249-403f39bdb0bc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.058513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.059152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.059434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.059709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.060873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.062325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.064454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:14 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:15.065379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.096524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.097406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.097708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.097989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] PATH_INFO: `/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.099665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] RBAC: Authorizing `identity:get_user(user_id=c3a7560fcbf84596bbf53086e9d2d4b3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.101733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.104105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:14 2022] GET /identity/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:15.104918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.182135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:15.191254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e6679-6875-4ff1-87f8-5f6ca1f3ee2f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.229235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.230176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.230463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.230862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.242524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:15.248388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:15.249244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:15.250011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:15.250581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 66/129] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:15.251115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.319504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310890-e3a6-4f0f-9af3-461c0ec2551c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.359797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a421cd-e2f7-4d96-8578-538535c88530 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.388562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.389205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.389487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.389865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.397091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.398348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.398583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.398995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.399282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.399564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.400730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 64/130] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:15 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:15.400919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.401640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.402336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.403986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:15 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:15.406971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.432341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:15.435534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:15.520140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4774-275a-4024-bbf1-0f95070f01bf None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.559718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.560486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.560777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.561109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/1c081f9eab664b059dac8390c8aac361/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.563823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a55b29c3502461cb780f9a3ce844b88, user_id=1c081f9eab664b059dac8390c8aac361, role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.565318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.583012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 68/132] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:15 2022] PUT /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/1c081f9eab664b059dac8390c8aac361/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:15.583672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.623098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57e53-cf52-4d52-991d-f0608483734a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.696711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:15.707198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b38b-f413-4bd5-9bca-31b2208d8458 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.710875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.711519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.711807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.712149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.712861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:15.713169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.714565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.738707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 65/133] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:15.745175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:15.747670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.748464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.748777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.749067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/c3a7560fcbf84596bbf53086e9d2d4b3/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.751206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a55b29c3502461cb780f9a3ce844b88, user_id=c3a7560fcbf84596bbf53086e9d2d4b3, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.752952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.783818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 69/134] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:15 2022] PUT /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/c3a7560fcbf84596bbf53086e9d2d4b3/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:15.900044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:15.929772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a3a2a-055c-46df-ab1a-f26796dd349b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:15.979871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cdfb4-2d1f-4b24-9832-d1e064746ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:15.980597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cdfb4-2d1f-4b24-9832-d1e064746ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:15.980893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cdfb4-2d1f-4b24-9832-d1e064746ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:15.981175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cdfb4-2d1f-4b24-9832-d1e064746ba7 None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:15.982357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cdfb4-2d1f-4b24-9832-d1e064746ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:15.983852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cdfb4-2d1f-4b24-9832-d1e064746ba7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:15.985680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 66/135] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:15 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:15.991893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:16.070402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382615af-673a-4f4c-9947-c5e8336961c9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:16.070737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382615af-673a-4f4c-9947-c5e8336961c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:16.070969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382615af-673a-4f4c-9947-c5e8336961c9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:16.072843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 67/136] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:16.077777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc577c-a20d-4260-bc19-986fad8b3602 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:16.078079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc577c-a20d-4260-bc19-986fad8b3602 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:16.078365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc577c-a20d-4260-bc19-986fad8b3602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:16.100568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-66fc577c-a20d-4260-bc19-986fad8b3602 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:16.101787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-66fc577c-a20d-4260-bc19-986fad8b3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:16.128997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b741-7e6f-4ff6-80ba-089f6256cb42 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:16.168231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:16.168927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:16.169216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:16.169498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] PATH_INFO: `/v3/projects/703d86004dbf411d9b022d635288f71b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:16.170678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] RBAC: Authorizing `identity:get_project(project_id=703d86004dbf411d9b022d635288f71b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:16.172232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:16.174241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 70/137] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:15 2022] GET /identity/v3/projects/703d86004dbf411d9b022d635288f71b => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:16.181237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:16.212661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:16.237036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 68/138] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:16.313324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e1fc-c029-4739-a9b3-793e9f963bf4 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:16.313925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e1fc-c029-4739-a9b3-793e9f963bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:16.314379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e1fc-c029-4739-a9b3-793e9f963bf4 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:16.315882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 69/139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:16.322567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f3c2-1bbe-4ec6-8d24-2081a0cca0a0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:16.323617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f3c2-1bbe-4ec6-8d24-2081a0cca0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:16.324127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f3c2-1bbe-4ec6-8d24-2081a0cca0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:16.333495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096ea24-8490-42bd-be36-1ef65d16ff3e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:16.345558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b967f3c2-1bbe-4ec6-8d24-2081a0cca0a0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:16.347482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b967f3c2-1bbe-4ec6-8d24-2081a0cca0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:16.390047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:16.390711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:16.391003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:16.391287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] PATH_INFO: `/v3/projects/703d86004dbf411d9b022d635288f71b/users/1c081f9eab664b059dac8390c8aac361/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:16.393580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=703d86004dbf411d9b022d635288f71b, user_id=1c081f9eab664b059dac8390c8aac361, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:16.395188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:16.421457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 71/140] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:16 2022] PUT /identity/v3/projects/703d86004dbf411d9b022d635288f71b/users/1c081f9eab664b059dac8390c8aac361/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:16.476249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 70/141] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:16.665495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:16.749017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:16.782067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e330-11b5-4901-b282-01c7524953b7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:16.825675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:16.826318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:16.826601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:16.826882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:16.859013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:16.864048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:16.865413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:16.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 72/142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:16.873413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967f3c2-1bbe-4ec6-8d24-2081a0cca0a0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:16.878035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:16.958755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:17.014860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967f3c2-1bbe-4ec6-8d24-2081a0cca0a0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:17.088655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:17.089276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.089557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.089834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.090514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:17.090822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:17.092235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:17.112036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 71/143] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:17.118209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:17.155225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec3fe0-1950-4a59-a20b-9e8f22cf58b2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:17.210225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:17.218707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:17.220242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.220859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.222023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.224339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:17.226070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:17.228077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 73/144] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:17.237402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:17.249572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:17.316396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07bbca-f0eb-49fb-8840-3e1194721232 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:17.386359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:17.387124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.387253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.387530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] PATH_INFO: `/v3/users/5b273dda053844d6b3ead9b894c6917a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.389420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] RBAC: Authorizing `identity:get_user(user_id=5b273dda053844d6b3ead9b894c6917a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:17.390893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:17.396224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 72/145] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:17 2022] GET /identity/v3/users/5b273dda053844d6b3ead9b894c6917a => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:17.399403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:17.417843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508468-6295-4cc2-9d93-b3cc085935c1 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:17.454953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:17.455691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.455973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.456251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.457029 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:17.459006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:17.482144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 74/146] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:14:17 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:17.549066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088a6b9-36cf-458c-a4ac-ae9890569f6c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:17.588555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b0e89-e434-4b83-9391-33f08ca4f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:17.589605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0e89-e434-4b83-9391-33f08ca4f1ad None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.590107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0e89-e434-4b83-9391-33f08ca4f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.590596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0e89-e434-4b83-9391-33f08ca4f1ad None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.592002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b0e89-e434-4b83-9391-33f08ca4f1ad None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:17.593726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b0e89-e434-4b83-9391-33f08ca4f1ad None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:17.595862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 73/147] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:17 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:17.601489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:17.725135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:17.801261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfadca-4bff-4306-9c31-783e8c403fd6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:17.838007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3977682-b1f0-49bc-96f3-5cab1a8ed5bd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.838316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3977682-b1f0-49bc-96f3-5cab1a8ed5bd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.838565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3977682-b1f0-49bc-96f3-5cab1a8ed5bd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.840025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 74/148] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:17.846438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656f17-89ce-46db-9627-e7e35ef5320b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.846438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656f17-89ce-46db-9627-e7e35ef5320b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.846654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656f17-89ce-46db-9627-e7e35ef5320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.849027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:17.849705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:17.849992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:17.850281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/5b273dda053844d6b3ead9b894c6917a/roles/dfa8f9e26cf14ca9ad2e0e641fcbf2e6` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:17.853724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a55b29c3502461cb780f9a3ce844b88, user_id=5b273dda053844d6b3ead9b894c6917a, role_id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:17.855503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:17.859195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:17.870852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-33656f17-89ce-46db-9627-e7e35ef5320b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:17.872358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-33656f17-89ce-46db-9627-e7e35ef5320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:17.873482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 75/149] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:17 2022] PUT /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88/users/5b273dda053844d6b3ead9b894c6917a/roles/dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:17.982079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:18.407888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:18.528853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007768fd-7ae7-43c2-a18a-41e5a8c3ca27 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:18.545524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:18.568749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:18.569815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:18.570097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:18.570369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:18.582073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:18.588098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:18.589001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:18.589833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 76/151] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:18.595443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656f17-89ce-46db-9627-e7e35ef5320b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:18.719969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656f17-89ce-46db-9627-e7e35ef5320b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:18.758220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:18.763891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7f27b-9cff-441c-88cb-053524f705b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:18.766788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f27b-9cff-441c-88cb-053524f705b6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:18.767091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f27b-9cff-441c-88cb-053524f705b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:18.767370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f27b-9cff-441c-88cb-053524f705b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:18.768051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7f27b-9cff-441c-88cb-053524f705b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:18.768378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7f27b-9cff-441c-88cb-053524f705b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:18.769774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7f27b-9cff-441c-88cb-053524f705b6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:18.778833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 76/152] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:18.786446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:18.900733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6eca4-1b48-49ed-b4e7-5aac34bdea0b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:18.901323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6eca4-1b48-49ed-b4e7-5aac34bdea0b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:18.901764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6eca4-1b48-49ed-b4e7-5aac34bdea0b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:18.903260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 77/153] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:18.911823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2357-ad1f-4ed3-8efd-5919730bc0bb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:18.912380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2357-ad1f-4ed3-8efd-5919730bc0bb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:18.912862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2357-ad1f-4ed3-8efd-5919730bc0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:18.939284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055c96-16e9-4681-a8d5-f54d5b840fb9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:18.941292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4ccf2357-ad1f-4ed3-8efd-5919730bc0bb None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:18.943067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4ccf2357-ad1f-4ed3-8efd-5919730bc0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:18.993276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:18.994202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:18.994731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:18.995218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:18.996565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:18.998836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:19.000804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 77/154] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:18 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:19.006650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:19.079118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:19.106789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 78/155] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:19.171750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bd3a7-6207-4cc3-8b88-8372eb970c14 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:19.212786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:19.213403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:19.213681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:19.213953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:19.303508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:19.304928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:19.355151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:19.435448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 78/156] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 05:14:19.442613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2357-ad1f-4ed3-8efd-5919730bc0bb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:19.599495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2357-ad1f-4ed3-8efd-5919730bc0bb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:19.625350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:19.637501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b87b7b-fe81-41d5-be9a-b44ec72dc3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:19.638143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87b7b-fe81-41d5-be9a-b44ec72dc3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:19.638423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87b7b-fe81-41d5-be9a-b44ec72dc3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:19.638692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87b7b-fe81-41d5-be9a-b44ec72dc3d5 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:19.639839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b87b7b-fe81-41d5-be9a-b44ec72dc3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:19.641329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b87b7b-fe81-41d5-be9a-b44ec72dc3d5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:19.642963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 79/157] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:19 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:19.650205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:19.723374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991bf54-5f84-4d3a-b3ad-6587e4c9c84d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:19.723712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991bf54-5f84-4d3a-b3ad-6587e4c9c84d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:19.723966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991bf54-5f84-4d3a-b3ad-6587e4c9c84d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:19.725506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 80/158] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:19.732189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8412ef-6bd8-427c-a3a0-87fe82c130f0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:19.732519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8412ef-6bd8-427c-a3a0-87fe82c130f0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:19.732788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8412ef-6bd8-427c-a3a0-87fe82c130f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:19.765287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8e8412ef-6bd8-427c-a3a0-87fe82c130f0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:19.766493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8e8412ef-6bd8-427c-a3a0-87fe82c130f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:19.814597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3596b8a-2cee-4c1d-872d-f5a7f0ae4bc2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:19.859052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:19.859311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:19.859588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:19.859860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:19.860658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=1c081f9eab664b059dac8390c8aac361) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:19.861504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:19.863100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:19.870987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 79/159] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:19 2022] GET /identity/v3/role_assignments?user.id=1c081f9eab664b059dac8390c8aac361&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=75d345ed873a4df3be5afc217fb2676f => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:19.872051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:19.889837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:19.925996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 81/160] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:20.025476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747551ed-92a7-4785-b33f-14519754bbc3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:20.072461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:20.073117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:20.073401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:20.073672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:20.092992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:20.098308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:20.101316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:20.102123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 80/161] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:20.109576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8412ef-6bd8-427c-a3a0-87fe82c130f0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:20.246302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8412ef-6bd8-427c-a3a0-87fe82c130f0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:20.275724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:20.290062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306131-f464-4e37-ac11-becf3c5ae47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:20.290675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306131-f464-4e37-ac11-becf3c5ae47e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:20.290957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306131-f464-4e37-ac11-becf3c5ae47e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:20.291230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306131-f464-4e37-ac11-becf3c5ae47e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:20.291899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306131-f464-4e37-ac11-becf3c5ae47e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:20.292202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306131-f464-4e37-ac11-becf3c5ae47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:20.293653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306131-f464-4e37-ac11-becf3c5ae47e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:20.302953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 82/162] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:20.308907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:20.376955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:20.386513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244187-7e3f-490d-b2a2-b91e8d971b8b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:20.386807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244187-7e3f-490d-b2a2-b91e8d971b8b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:20.387070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244187-7e3f-490d-b2a2-b91e8d971b8b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:20.388431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 83/163] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:20.393622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ee696-9693-4485-8bee-e47d0f515d4f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:20.393903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ee696-9693-4485-8bee-e47d0f515d4f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:20.394179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ee696-9693-4485-8bee-e47d0f515d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:20.420019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-336ee696-9693-4485-8bee-e47d0f515d4f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:20.421237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-336ee696-9693-4485-8bee-e47d0f515d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:20.441780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6522b0-a28d-4b64-a786-b4ab119f5bf4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:20.500944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:20.501586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:20.501871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:20.502146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:20.506398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:20.507878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:20.509695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 81/164] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:20 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:20.514487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:20.530742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 84/165] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 21 05:14:20.531603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ee696-9693-4485-8bee-e47d0f515d4f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:20.723347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b853e-f186-4a42-9531-cb861ba2419e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:20.784404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:20.785044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:20.785327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:20.785657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:20.789773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:20.790155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ee696-9693-4485-8bee-e47d0f515d4f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:20.813730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:20.819523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:20.820394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:20.821400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 82/166] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:20.823699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:20.828462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:20.897898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:20.904738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:20.905037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:20.905323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.027517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366df37-3221-4928-ad49-7d1156a0ad45 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:21.064460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:21.065307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:21.065798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:21.066235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.067055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:21.068022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:21.070038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:21.087386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 83/167] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:21.088579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:21.105036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:21.106519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:21.206995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:21.288777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 85/168] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:21.289866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:21.305899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:21.323038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc0d39-432a-4d65-877a-4434e9618171 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:21.396346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:21.396999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:21.397358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:21.397545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.420749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:21.434704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:21.435738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:21.436601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 84/169] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:21.437274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:21.443153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257309-e225-4f83-8965-3ed6d700e83d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:21.549110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:21.549730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:21.550064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:21.550566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] PATH_INFO: `/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.553468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a7560fcbf84596bbf53086e9d2d4b3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:21.554965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:21.560569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 86/170] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:21 2022] GET /identity/v3/users/c3a7560fcbf84596bbf53086e9d2d4b3 => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:21.561252 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:21.575340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a7215-3ae2-48d4-9a36-3362d07e7f98 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:21.603172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:21.639905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f973cfc-afac-4dc9-8b2c-a940e75894be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:21.640966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f973cfc-afac-4dc9-8b2c-a940e75894be None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:21.641458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f973cfc-afac-4dc9-8b2c-a940e75894be None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:21.641934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f973cfc-afac-4dc9-8b2c-a940e75894be None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.643955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f973cfc-afac-4dc9-8b2c-a940e75894be None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:21.645679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f973cfc-afac-4dc9-8b2c-a940e75894be None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:21.647708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 85/171] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:21 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:21.651238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a49-cdd3-4ae0-b5a4-b85f68db6356 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:21.654427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a49-cdd3-4ae0-b5a4-b85f68db6356 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:21.655017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a49-cdd3-4ae0-b5a4-b85f68db6356 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.661716 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 86/172] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:21.662770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15a49-cdd3-4ae0-b5a4-b85f68db6356 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:21.720669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:21.767193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5d3c3-70d6-4625-8418-b6df153230e5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:21.775720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15a49-cdd3-4ae0-b5a4-b85f68db6356 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:21.823050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3103812-866c-48c4-bab8-837c85f043ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:21.823587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103812-866c-48c4-bab8-837c85f043ee None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:21.823872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103812-866c-48c4-bab8-837c85f043ee None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:21.824151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103812-866c-48c4-bab8-837c85f043ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.884990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:21.885625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:21.885912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:21.886186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:21.886862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:21.887164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:21.888580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:21.898806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:21.904018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 87/173] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:21.904650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:21.907765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3103812-866c-48c4-bab8-837c85f043ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:21.909785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3103812-866c-48c4-bab8-837c85f043ee None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:22.059848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 87/174] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:22.061553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f325d5-0029-444f-b8ef-9d436cdfa2d4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.061553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f325d5-0029-444f-b8ef-9d436cdfa2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.061748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f325d5-0029-444f-b8ef-9d436cdfa2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.083583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b4e2-cea6-4205-8986-424f969db245 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:22.093985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-95f325d5-0029-444f-b8ef-9d436cdfa2d4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:22.095247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-95f325d5-0029-444f-b8ef-9d436cdfa2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:22.177150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:22.177790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.178075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.178361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.179113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] RBAC: Adding query filter params (role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=1c081f9eab664b059dac8390c8aac361) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:22.179421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:22.180931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:22.192194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 88/175] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:22.193376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f325d5-0029-444f-b8ef-9d436cdfa2d4 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:22.198493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 88/176] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:21 2022] GET /identity/v3/role_assignments?user.id=1c081f9eab664b059dac8390c8aac361&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:22.199349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:22.213726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:22.228669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:22.313757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f325d5-0029-444f-b8ef-9d436cdfa2d4 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:22.358015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:22.358913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.359363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.359791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] PATH_INFO: `/v3/users/1c081f9eab664b059dac8390c8aac361` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.365336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] RBAC: Authorizing `identity:get_user(user_id=1c081f9eab664b059dac8390c8aac361)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:22.367355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:22.369441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 89/177] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:22 2022] GET /identity/v3/users/1c081f9eab664b059dac8390c8aac361 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:22.375208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:22.437731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd6a2-ac36-4f4b-84a7-53295eef1df6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:22.470002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:22.505313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b1e3f-ef20-448a-a4c5-7295f7738319 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:22.517736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda15a3-a9be-4199-ab6d-d8a23c7ae2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:22.518396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda15a3-a9be-4199-ab6d-d8a23c7ae2dc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.518669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda15a3-a9be-4199-ab6d-d8a23c7ae2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.518942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda15a3-a9be-4199-ab6d-d8a23c7ae2dc None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.522303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda15a3-a9be-4199-ab6d-d8a23c7ae2dc None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:22.523772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda15a3-a9be-4199-ab6d-d8a23c7ae2dc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:22.525475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 89/178] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:22 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:22.526738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde9a2-d8f0-46ef-a730-f6cbc221edcb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.527020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde9a2-d8f0-46ef-a730-f6cbc221edcb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.527291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde9a2-d8f0-46ef-a730-f6cbc221edcb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.528503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 90/179] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:22.534355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e68fbc-1173-4bfc-ad4b-c94747042799 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.534633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e68fbc-1173-4bfc-ad4b-c94747042799 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.535398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e68fbc-1173-4bfc-ad4b-c94747042799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.564703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:22.565745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.566252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.566732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.572352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-91e68fbc-1173-4bfc-ad4b-c94747042799 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:22.574275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-91e68fbc-1173-4bfc-ad4b-c94747042799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:22.647873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:22.650081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:22.700321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 91/180] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:22.701185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e68fbc-1173-4bfc-ad4b-c94747042799 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:22.720664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:22.744904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:22.764830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 05:14:22.766035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:22.840550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e68fbc-1173-4bfc-ad4b-c94747042799 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:22.886009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:22.886009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.886009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.887192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.887192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=c3a7560fcbf84596bbf53086e9d2d4b3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:22.887418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:22.888786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:22.895861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7dcd-3b13-4cec-8194-df859186447e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:22.896588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 92/182] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:22 2022] GET /identity/v3/role_assignments?user.id=c3a7560fcbf84596bbf53086e9d2d4b3&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:22.897639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:22.976896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0dcf9-e4ce-4001-a1ab-758002648cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:22.978012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0dcf9-e4ce-4001-a1ab-758002648cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:22.978502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0dcf9-e4ce-4001-a1ab-758002648cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:22.978980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0dcf9-e4ce-4001-a1ab-758002648cc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:22.994386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.005603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0dcf9-e4ce-4001-a1ab-758002648cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-2df0dcf9-e4ce-4001-a1ab-758002648cc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:23.011011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:23.011966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:23.012803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:23.015171 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 91/183] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:23.016726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ca3b-c79a-4117-a62a-47d9b4018d63 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.017405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ca3b-c79a-4117-a62a-47d9b4018d63 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.017903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ca3b-c79a-4117-a62a-47d9b4018d63 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.019488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 92/184] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:23.025605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ca3b-c79a-4117-a62a-47d9b4018d63 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.036909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f81c7-d309-48e5-a63d-c9bfb6c86807 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.077183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408c2d3-c2e0-4f36-9fc7-7f30317f6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.077840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c2d3-c2e0-4f36-9fc7-7f30317f6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.078121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c2d3-c2e0-4f36-9fc7-7f30317f6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.079628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c2d3-c2e0-4f36-9fc7-7f30317f6bf8 None admin] PATH_INFO: `/v3/projects/703d86004dbf411d9b022d635288f71b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.080515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408c2d3-c2e0-4f36-9fc7-7f30317f6bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=703d86004dbf411d9b022d635288f71b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:23.082278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408c2d3-c2e0-4f36-9fc7-7f30317f6bf8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:23.084414 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 93/185] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:22 2022] GET /identity/v3/projects/703d86004dbf411d9b022d635288f71b => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:23.086378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b32fd-74d8-42b9-b1eb-a079b4265e17 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.086779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b32fd-74d8-42b9-b1eb-a079b4265e17 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.087154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b32fd-74d8-42b9-b1eb-a079b4265e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.110551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bf7b32fd-74d8-42b9-b1eb-a079b4265e17 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:23.111900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bf7b32fd-74d8-42b9-b1eb-a079b4265e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:23.120515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.191844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ca3b-c79a-4117-a62a-47d9b4018d63 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.193950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 94/186] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:23.197953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b32fd-74d8-42b9-b1eb-a079b4265e17 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.231898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.232749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.233173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.233586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.234931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:23.236595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:23.241501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:23.252386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 93/187] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:23.253654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.280473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.318250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b32fd-74d8-42b9-b1eb-a079b4265e17 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.356931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347d1c1-340d-4c1f-a7a6-6be98801d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.357546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d1c1-340d-4c1f-a7a6-6be98801d698 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.357828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d1c1-340d-4c1f-a7a6-6be98801d698 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.358104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d1c1-340d-4c1f-a7a6-6be98801d698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.358830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347d1c1-340d-4c1f-a7a6-6be98801d698 None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=703d86004dbf411d9b022d635288f71b, user.id=1c081f9eab664b059dac8390c8aac361) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:23.359139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347d1c1-340d-4c1f-a7a6-6be98801d698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:23.360623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347d1c1-340d-4c1f-a7a6-6be98801d698 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:23.366998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 95/188] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/role_assignments?user.id=1c081f9eab664b059dac8390c8aac361&scope.project.id=703d86004dbf411d9b022d635288f71b&role.id=75d345ed873a4df3be5afc217fb2676f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:23.368142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a302-b1ee-48bf-8f53-fee51d233fff None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.368457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a302-b1ee-48bf-8f53-fee51d233fff None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.368734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a302-b1ee-48bf-8f53-fee51d233fff None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.372315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 96/189] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:23.372315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039a302-b1ee-48bf-8f53-fee51d233fff None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.394309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628b11-5cdf-4bee-a14a-ca5cd71850f2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.398070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.435136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384de39-96b9-4a07-a3c8-4608891af6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.435795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384de39-96b9-4a07-a3c8-4608891af6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.436077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384de39-96b9-4a07-a3c8-4608891af6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.437215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384de39-96b9-4a07-a3c8-4608891af6e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.450635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384de39-96b9-4a07-a3c8-4608891af6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-7384de39-96b9-4a07-a3c8-4608891af6e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:23.456108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:23.457223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:23.458065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 94/190] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:23.458720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796247-a2f6-4a62-b091-23cfc1784b5c None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.459231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796247-a2f6-4a62-b091-23cfc1784b5c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.459231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796247-a2f6-4a62-b091-23cfc1784b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.479278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-65796247-a2f6-4a62-b091-23cfc1784b5c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-65796247-a2f6-4a62-b091-23cfc1784b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:23.522543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039a302-b1ee-48bf-8f53-fee51d233fff None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.556527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 95/191] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:23.557390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796247-a2f6-4a62-b091-23cfc1784b5c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.563042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.563668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.563942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.564210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] PATH_INFO: `/v3/users/5b273dda053844d6b3ead9b894c6917a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.565357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] RBAC: Authorizing `identity:get_user(user_id=5b273dda053844d6b3ead9b894c6917a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:23.566798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:23.568598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 97/192] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/users/5b273dda053844d6b3ead9b894c6917a => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:23.569274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.584653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.699355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.703830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b39f-e59a-4971-94cf-fa9215649d2e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.708393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796247-a2f6-4a62-b091-23cfc1784b5c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.743336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.744271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.744502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.744985 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.745111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.745375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.745647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.745995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.746341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:23.746642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:23.748310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:23.756740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 96/193] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:23.757340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.762726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:23.768350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:23.769198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 98/194] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:23.773133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.829544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.871689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781b1ff-7f51-47b5-b20b-1e04fef16141 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.875228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8149-2ff0-4d92-8529-f18de0a731d5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:23.905580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.906206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.906487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.906769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] PATH_INFO: `/v3/users/0d3d6c05cbfb4e06a78269570b02cb97` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.908146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:23.908774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:23.909050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:23.909964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:23.920214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3d6c05cbfb4e06a78269570b02cb97)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:23.921711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:23.923324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 99/195] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/users/0d3d6c05cbfb4e06a78269570b02cb97 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:23.923324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:23.939247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:23.987359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:23.988861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.026814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543747-a878-4df7-9519-52c378c2fac6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.043549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.060106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.060747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.061031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.061303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.062274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:24.062274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.063611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.071974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 100/196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:24.074150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.085711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 97/197] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:24.086400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.139311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.175694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180de4c-850b-4b47-93f0-720913cc9a6d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.182201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d78e7-5c0c-4526-9bfb-baa70a1e637d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.209237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.209865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.210145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.210422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.211513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.213107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.214695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 101/198] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:24.215476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.216382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.217157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.217441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.217828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.262831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.286393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.288201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.321141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ce015-823e-4b6f-a3cd-701c74c66245 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.343590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.354664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.355293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.355571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.355843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] PATH_INFO: `/v3/users/0d3d6c05cbfb4e06a78269570b02cb97` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.356973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] RBAC: Authorizing `identity:get_user(user_id=0d3d6c05cbfb4e06a78269570b02cb97)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.358426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.359995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 102/199] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/users/0d3d6c05cbfb4e06a78269570b02cb97 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:24.360784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.393530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 98/200] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:24.393530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.458570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4894847-b05c-44d3-a2c4-87c8745c4b8a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.473535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.484695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef730cf-90d9-4419-95f0-abfb64a7e375 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.492136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.492789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.493067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.493339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.494446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.495905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.497796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 103/201] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:24.498560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.524291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.524903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.525184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.525704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.526101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.527541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.560403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 99/202] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:14:24 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:24.560403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.565369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.619044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff266158-48b5-4caf-a567-dbc8891d5585 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.654429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.655053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.655331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.655602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.668981 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2444d-5c0f-4f1d-af32-ed081c0fcefb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.707554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.709575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.709995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.710407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.711490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.712682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.714483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.717143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 100/203] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:24.718100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.736111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.737623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.814355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.837228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b6ad7-e6e4-4790-8382-95f00de59042 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:24.865710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 104/204] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:24.867014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.885477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:24.886100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:24.887365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:24.887365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:24.887365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] RBAC: Adding query filter params (role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6, scope.project.id=3a55b29c3502461cb780f9a3ce844b88, user.id=5b273dda053844d6b3ead9b894c6917a) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:24.888121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:24.889161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:24.898589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 101/205] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/role_assignments?user.id=5b273dda053844d6b3ead9b894c6917a&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:24.898838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:24.971073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:24.989787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f537b1b-3d7f-43f9-8eef-8f97f491a74f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:25.029542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:25.030159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:25.030435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:25.030776 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:25.031439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] RBAC: Adding query filter params (role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=0d3d6c05cbfb4e06a78269570b02cb97) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:25.031745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:25.033258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:25.039422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 105/206] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/role_assignments?user.id=0d3d6c05cbfb4e06a78269570b02cb97&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:25.041667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d5b8-2c5c-479e-9602-e85c2a741ae7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:25.084619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea0f7a-e505-4ccc-ab28-b44408c190e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:25.085272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0f7a-e505-4ccc-ab28-b44408c190e9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:25.085548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0f7a-e505-4ccc-ab28-b44408c190e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:25.085819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0f7a-e505-4ccc-ab28-b44408c190e9 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:25.086969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea0f7a-e505-4ccc-ab28-b44408c190e9 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:25.088647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea0f7a-e505-4ccc-ab28-b44408c190e9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:25.095718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 102/207] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:24 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:25.097230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:25.231574 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e019-e2fc-4edb-8192-fd0726ddceed None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:25.267789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5a8f-eb83-4c95-b9cf-8490936ad3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:25.268439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5a8f-eb83-4c95-b9cf-8490936ad3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:25.268782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5a8f-eb83-4c95-b9cf-8490936ad3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:25.269054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5a8f-eb83-4c95-b9cf-8490936ad3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:25.269832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5a8f-eb83-4c95-b9cf-8490936ad3f3 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=0d3d6c05cbfb4e06a78269570b02cb97) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:25.270140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5a8f-eb83-4c95-b9cf-8490936ad3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:25.271672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5a8f-eb83-4c95-b9cf-8490936ad3f3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:25.278056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 106/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:25 2022] GET /identity/v3/role_assignments?user.id=0d3d6c05cbfb4e06a78269570b02cb97&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:26.944306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3857-907d-4fdd-b1a1-f5578c032565 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:26.944821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3857-907d-4fdd-b1a1-f5578c032565 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:26.945093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3857-907d-4fdd-b1a1-f5578c032565 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:26.946801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 103/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:26.952152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ea88-9e04-4c30-bd64-c0f0ccec5663 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:26.952598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ea88-9e04-4c30-bd64-c0f0ccec5663 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:26.952930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ea88-9e04-4c30-bd64-c0f0ccec5663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:26.971463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a4c0ea88-9e04-4c30-bd64-c0f0ccec5663 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:26.972710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a4c0ea88-9e04-4c30-bd64-c0f0ccec5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:26.982608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:27.051626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 107/210] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:27.104719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caf6c6-e6c8-4909-85d7-1dac5528b13e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.105030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caf6c6-e6c8-4909-85d7-1dac5528b13e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.105274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caf6c6-e6c8-4909-85d7-1dac5528b13e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.106616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 104/211] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:27.111809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963cea3-a75a-4825-9a77-f5065820d4fc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.112040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963cea3-a75a-4825-9a77-f5065820d4fc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.112335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963cea3-a75a-4825-9a77-f5065820d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.131439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d963cea3-a75a-4825-9a77-f5065820d4fc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:27.132644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d963cea3-a75a-4825-9a77-f5065820d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:27.212157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 108/212] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:27.300751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4c5c-2a5f-47ca-b428-0a3f528aec53 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.301064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4c5c-2a5f-47ca-b428-0a3f528aec53 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.301306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4c5c-2a5f-47ca-b428-0a3f528aec53 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.303209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 105/213] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:27.308514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2dab7-6e6f-4d15-ade9-1924a071afca None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.308805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2dab7-6e6f-4d15-ade9-1924a071afca None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.309084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2dab7-6e6f-4d15-ade9-1924a071afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.321111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c4c5c-2a5f-47ca-b428-0a3f528aec53 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:27.330795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7aa2dab7-6e6f-4d15-ade9-1924a071afca None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:27.332003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7aa2dab7-6e6f-4d15-ade9-1924a071afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:27.338408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:27.412760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 109/214] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:27.438026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c4c5c-2a5f-47ca-b428-0a3f528aec53 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:27.450579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3f0d1-73e1-40f6-8ca9-895f0d6965c7 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.450867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3f0d1-73e1-40f6-8ca9-895f0d6965c7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.451140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3f0d1-73e1-40f6-8ca9-895f0d6965c7 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.452615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 110/215] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:27.457446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d31a-0d95-4515-bd55-5bd6ed51f0d3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.458495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d31a-0d95-4515-bd55-5bd6ed51f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.458969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d31a-0d95-4515-bd55-5bd6ed51f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.465514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:27.474010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:27.474823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.475241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.475675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.481761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-72d7d31a-0d95-4515-bd55-5bd6ed51f0d3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:27.483295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-72d7d31a-0d95-4515-bd55-5bd6ed51f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:27.487969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:27.493166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:27.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:27.495176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:27.497396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 106/216] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:27.502935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:27.564458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 111/217] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:27.565319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d31a-0d95-4515-bd55-5bd6ed51f0d3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:27.591547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:27.625152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18370d-23bf-4a01-909b-84df872ac867 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:27.662211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:27.662927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.663155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.663427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.664086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:27.664466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:27.666367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:27.675286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 107/218] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:27.681122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:27.700351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d31a-0d95-4515-bd55-5bd6ed51f0d3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:27.732250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:27.738395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:27.739366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.739651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.740182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.741459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:27.743503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:27.746196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 112/219] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:27.747287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:27.783967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c919979-757e-4b57-90c6-97494b0634b9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:27.819524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:27.820161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.820478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.820755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] PATH_INFO: `/v3/users/76981f7b6f2d4f08b708716ac9a67293` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.822643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:27.837827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] RBAC: Authorizing `identity:get_user(user_id=76981f7b6f2d4f08b708716ac9a67293)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:27.839439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:27.845473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 108/220] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:27 2022] GET /identity/v3/users/76981f7b6f2d4f08b708716ac9a67293 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:27.845473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:27.864513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0aa60-f89d-421e-a9df-62cabb246fb6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:27.899468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:27.900097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.900475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.900756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.910476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:27.915337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:27.916311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:27.917102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 113/221] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:27.917769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:27.946797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900baf15-fa32-4857-b520-1748026c5a3c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:27.976977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:27.981531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:27.982147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:27.982434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:27.982714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:27.983367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:27.984853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.006954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 109/222] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:14:27 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:28.006954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.027803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35cc57-d3c4-4088-bab9-ff4b63d843a0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.065371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.066035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.066385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.066664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.067932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:28.080076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:28.085155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:28.086282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 114/223] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:28.087245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.135461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e12cdd-5b96-438f-b0a4-7b277a27a1eb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.173857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.174388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.174667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.174941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.211941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085a0a2-148f-4ac8-b1ec-10dbab3f4086 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.236889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:28.253081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.253693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.253974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.254247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.255508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.255611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:28.255838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.257080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.257327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.266709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 115/224] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.267951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.319259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:28.388440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 110/225] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:28.389103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.390867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe51ba-f4bf-41cc-9618-49e7674bb726 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.442199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.443531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.444250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.444853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.445973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:28.446902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.449052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.460922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 116/226] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.462396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.507303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d7944-8b44-49c9-bf56-beb9fd127d05 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.524392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:28.552102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.553114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.553889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.555274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] PATH_INFO: `/v3/users/0d3d6c05cbfb4e06a78269570b02cb97` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.556702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] RBAC: Authorizing `identity:get_user(user_id=0d3d6c05cbfb4e06a78269570b02cb97)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.558362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.565655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 111/227] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/users/0d3d6c05cbfb4e06a78269570b02cb97 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.565655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.589871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0f4d-9015-4f09-8849-4349fc76abf1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.590542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:28.628661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.629635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.629765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.629960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.631143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.632709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.634672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 117/228] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.635304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.699310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379466-b7cb-46f7-a863-98a8c5494a1c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.744137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef604-04b0-4674-b47e-6f961528ce30 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.745345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.747591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.748090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.748590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] PATH_INFO: `/v3/users/0d3d6c05cbfb4e06a78269570b02cb97` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.749913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] RBAC: Authorizing `identity:get_user(user_id=0d3d6c05cbfb4e06a78269570b02cb97)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.751540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.754612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 112/229] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/users/0d3d6c05cbfb4e06a78269570b02cb97 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.755658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.762794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:28.786375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.786958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.787236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.787508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.788666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.790219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.791948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 118/230] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.796844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.870644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:28.891103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f332-402f-47ab-b579-da20340f1fee None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.925755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.926938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a89b6e-11f5-4467-8380-1d51fd9f3f29 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:28.927372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.927830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.928104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.928980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=76981f7b6f2d4f08b708716ac9a67293) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:28.929280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.930745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.938823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 113/231] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/role_assignments?user.id=76981f7b6f2d4f08b708716ac9a67293&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=75d345ed873a4df3be5afc217fb2676f => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.939654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:28.970310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:28.971315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:28.971845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:28.972488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:28.974088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:28.976093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:28.978241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 119/232] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:28 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:28.985046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:29.053307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:29.122563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed5489-b8cb-4407-8819-9a73247bf23e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:29.155925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538dcf5-ed2f-42a4-b0b0-9b10ea17b27a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:29.170012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59690c-f70c-4c6d-95f6-e020469cb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:29.171209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59690c-f70c-4c6d-95f6-e020469cb231 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:29.172153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59690c-f70c-4c6d-95f6-e020469cb231 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:29.172929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59690c-f70c-4c6d-95f6-e020469cb231 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/0d3d6c05cbfb4e06a78269570b02cb97/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:29.175610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59690c-f70c-4c6d-95f6-e020469cb231 None admin] RBAC: Authorizing `identity:create_grant(project_id=0866ec7b5e9f4d4c947e6a65533662f7, user_id=0d3d6c05cbfb4e06a78269570b02cb97, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:29.177957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59690c-f70c-4c6d-95f6-e020469cb231 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:29.195464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8fff3-a163-458f-b526-ab24ce8486e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:29.196155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8fff3-a163-458f-b526-ab24ce8486e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:29.196520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8fff3-a163-458f-b526-ab24ce8486e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:29.196833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8fff3-a163-458f-b526-ab24ce8486e4 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/0d3d6c05cbfb4e06a78269570b02cb97/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:29.200305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8fff3-a163-458f-b526-ab24ce8486e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0866ec7b5e9f4d4c947e6a65533662f7, user_id=0d3d6c05cbfb4e06a78269570b02cb97, role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:29.201495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8fff3-a163-458f-b526-ab24ce8486e4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:29.204118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 120/233] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:28 2022] PUT /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/0d3d6c05cbfb4e06a78269570b02cb97/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:14:29.220897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:28 2022] PUT /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/0d3d6c05cbfb4e06a78269570b02cb97/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:30.615125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0162f-beb6-410d-8441-a10ef66ca089 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:30.615675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0162f-beb6-410d-8441-a10ef66ca089 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:30.615675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0162f-beb6-410d-8441-a10ef66ca089 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:30.617038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 121/235] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:30.622566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b176-6448-4622-a2a1-d4f2459e182d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:30.623333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b176-6448-4622-a2a1-d4f2459e182d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:30.623819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b176-6448-4622-a2a1-d4f2459e182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:30.649208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-3b10b176-6448-4622-a2a1-d4f2459e182d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:30.650390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3b10b176-6448-4622-a2a1-d4f2459e182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:30.652571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:30.739502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 115/236] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:30.752154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca2f6-fa1a-4331-9c37-c2940ee5147a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:30.752470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca2f6-fa1a-4331-9c37-c2940ee5147a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:30.752750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca2f6-fa1a-4331-9c37-c2940ee5147a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:30.754072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 122/237] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:30.766216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f442589-55eb-4ad8-b42d-0e0805a978e0 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:30.766502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f442589-55eb-4ad8-b42d-0e0805a978e0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:30.766774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f442589-55eb-4ad8-b42d-0e0805a978e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:30.790208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5f442589-55eb-4ad8-b42d-0e0805a978e0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:30.791368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5f442589-55eb-4ad8-b42d-0e0805a978e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:30.899164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 116/238] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:31.047937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca2f6-fa1a-4331-9c37-c2940ee5147a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:31.166380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca2f6-fa1a-4331-9c37-c2940ee5147a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:31.176831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:31.202057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:31.202697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.203384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.204293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.205469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:31.207054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:31.213346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 123/239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:31.215218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f442589-55eb-4ad8-b42d-0e0805a978e0 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:31.305585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:31.330312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:31.355044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f442589-55eb-4ad8-b42d-0e0805a978e0 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:31.425115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:31.425664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.425950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.426267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.426941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:31.428428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:31.438442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc0ffd-8f5e-4174-899e-f9fdc32491f0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:31.476212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:31.477073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.477456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.477798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.487148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 117/240] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:14:31 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:14:31.495029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:31.501006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:31.501869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:31.502653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 124/241] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:31.510527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:31.677481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c653b-ed76-47a9-a583-d5ffbb9a6517 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:31.708695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:31.722372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134de3-b818-40c9-b72a-fb0fefbc49c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:31.723012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134de3-b818-40c9-b72a-fb0fefbc49c2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.723357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134de3-b818-40c9-b72a-fb0fefbc49c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.723754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134de3-b818-40c9-b72a-fb0fefbc49c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.724457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134de3-b818-40c9-b72a-fb0fefbc49c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:31.724761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134de3-b818-40c9-b72a-fb0fefbc49c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:31.726139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134de3-b818-40c9-b72a-fb0fefbc49c2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:31.735203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 118/242] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:31.741167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:31.774598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401cf7d-1dcc-4e15-957e-2ef861247a6f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.774896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401cf7d-1dcc-4e15-957e-2ef861247a6f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.775161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401cf7d-1dcc-4e15-957e-2ef861247a6f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.776745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 119/243] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:31.778408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:31.782591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834de8c-3c69-43db-be39-7f851e7a86fa None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.782935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834de8c-3c69-43db-be39-7f851e7a86fa None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.783172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834de8c-3c69-43db-be39-7f851e7a86fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.810722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c834de8c-3c69-43db-be39-7f851e7a86fa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:31.811917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c834de8c-3c69-43db-be39-7f851e7a86fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:31.857374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f6568-a70d-4312-8876-b712cd3e451c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:31.901490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcf179-b93f-4320-ab84-2f955d16c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:31.902169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf179-b93f-4320-ab84-2f955d16c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.902523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf179-b93f-4320-ab84-2f955d16c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.902802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf179-b93f-4320-ab84-2f955d16c0a9 None admin] PATH_INFO: `/v3/users/793c37b6f89a4e71ab3f1a79c0938e01` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.907527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 120/244] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:31.918151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcf179-b93f-4320-ab84-2f955d16c0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=793c37b6f89a4e71ab3f1a79c0938e01)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:31.919657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcf179-b93f-4320-ab84-2f955d16c0a9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:31.921540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 125/245] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:31 2022] GET /identity/v3/users/793c37b6f89a4e71ab3f1a79c0938e01 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:31.927572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834de8c-3c69-43db-be39-7f851e7a86fa None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:31.987341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48430bdb-0ae9-4e70-9bfc-023ddb337d73 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.987657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48430bdb-0ae9-4e70-9bfc-023ddb337d73 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.987892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48430bdb-0ae9-4e70-9bfc-023ddb337d73 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:31.989796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 126/246] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:31.995096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082239d-dc8b-4f09-aa34-6f579b95a062 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:31.995384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082239d-dc8b-4f09-aa34-6f579b95a062 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:31.995658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082239d-dc8b-4f09-aa34-6f579b95a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.020472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8082239d-dc8b-4f09-aa34-6f579b95a062 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:32.021796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8082239d-dc8b-4f09-aa34-6f579b95a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:32.036626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834de8c-3c69-43db-be39-7f851e7a86fa None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:32.056875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:32.078568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:32.079834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.080342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.081104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.115300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 127/247] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:32.116537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44542936-69cd-4523-9f67-dcccc5d89a83 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.116825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44542936-69cd-4523-9f67-dcccc5d89a83 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.117093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44542936-69cd-4523-9f67-dcccc5d89a83 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.118336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 128/248] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:32.124098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e3cf4-39e8-4c1f-837d-e379646b59f2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.124403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e3cf4-39e8-4c1f-837d-e379646b59f2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.124682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e3cf4-39e8-4c1f-837d-e379646b59f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.147345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a44e3cf4-39e8-4c1f-837d-e379646b59f2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:32.148563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a44e3cf4-39e8-4c1f-837d-e379646b59f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:32.169410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:32.171560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:32.173062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:32.246047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 129/249] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:32.250329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e3cf4-39e8-4c1f-837d-e379646b59f2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:32.322356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 121/250] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:32.328270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:32.348097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:32.376995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e3cf4-39e8-4c1f-837d-e379646b59f2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:32.427280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:32.427913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.428190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.428487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.443393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:32.449448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371859b2-64a0-442c-ab00-2ae4281dca4f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:32.450387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:32.451280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:32.452055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:32.453652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 130/251] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:14:32.461204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:32.492493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:32.524946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:32.526629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.528560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.529037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.531265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:32.533807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:32.539881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 122/252] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:32 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:32.547803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:32.647293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5e19f-2e16-4e04-b302-de639c8fdafc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:32.653353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:32.673230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f20e5-4ee0-4424-99b7-f6014028fba2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:32.695580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:32.696200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.696505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.696783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.697454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:32.698197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:32.699905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:32.711415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 131/253] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:32.711921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:32.712399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:32.712589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.712853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.713129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.713868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] RBAC: Adding query filter params (role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=793c37b6f89a4e71ab3f1a79c0938e01) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:32.714180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:32.715633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:32.723625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 123/254] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:32 2022] GET /identity/v3/role_assignments?user.id=793c37b6f89a4e71ab3f1a79c0938e01&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:32.724493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:32.815860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:32.846697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045bd6f-dc36-4558-bc3a-04d31c80d06b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:32.928796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567803-9ebd-4fca-ba58-99a35e4fb618 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:32.932676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:32.933554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.934036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.934493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.961219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:32.968604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:32.969454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:32.970244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:32.970846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:32.970846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:32.970846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:32.971042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 132/255] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:32.971109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:32.971172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:32.998256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:33.010526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:33.011451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 124/256] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:33.013328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:33.038205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:33.141566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b752a-b74b-48bd-bf01-467dee24e8e0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.180127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.180773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.181055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.181313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.181986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:33.182299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.183676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.192885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 125/257] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:33.193578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:33.195885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902335e1-f214-415a-ad14-e053fd549cda None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.270238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:33.274446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.275106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.275390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.275691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] PATH_INFO: `/v3/users/76981f7b6f2d4f08b708716ac9a67293` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.278465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] RBAC: Authorizing `identity:get_user(user_id=76981f7b6f2d4f08b708716ac9a67293)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.279952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.281605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 133/258] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:32 2022] GET /identity/v3/users/76981f7b6f2d4f08b708716ac9a67293 => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:33.282378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:33.298195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:33.313551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7e8eb-33a1-4a53-9b70-3e7ed91bb61e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.353494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.354257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.354675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.354960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.355640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:33.355945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.357356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.365862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 126/259] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:33.367881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:33.474556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0171-cd96-45a2-96d9-2053453b3b45 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.510364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.511005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.511289 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.511565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.513317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.515060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.516788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95278c-4333-4e04-b3bc-d5b097f9e441 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.517041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 127/260] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:33 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:33.517823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:33.520773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:33.627643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66eef9-c3e7-427a-9692-98427f0783b3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.633522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.634508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.634976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.635480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] PATH_INFO: `/v3/users/0d3d6c05cbfb4e06a78269570b02cb97` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.636848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3d6c05cbfb4e06a78269570b02cb97)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.638499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.640262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 134/261] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:33 2022] GET /identity/v3/users/0d3d6c05cbfb4e06a78269570b02cb97 => generated 283 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:33.642173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:33.663036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.663661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.663949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.664225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] PATH_INFO: `/v3/users/0d3d6c05cbfb4e06a78269570b02cb97` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.668856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] RBAC: Authorizing `identity:get_user(user_id=0d3d6c05cbfb4e06a78269570b02cb97)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.668856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.668856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 128/262] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:33 2022] GET /identity/v3/users/0d3d6c05cbfb4e06a78269570b02cb97 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:33.669430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:33.756933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:33.779495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ea14-3392-4efe-89da-0c3b9c0f62cf None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.804513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:33.818427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.819261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.819682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.820533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.883916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e826-0936-431f-bbd6-008854e3a2c6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:33.896539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.898199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.954392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:33.955063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:33.955400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:33.955619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/76981f7b6f2d4f08b708716ac9a67293/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:33.961637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0866ec7b5e9f4d4c947e6a65533662f7, user_id=76981f7b6f2d4f08b708716ac9a67293, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:33.963041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:33.967262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:33.994715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 135/263] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:33 2022] PUT /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/76981f7b6f2d4f08b708716ac9a67293/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:33.995557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:34.016060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 129/264] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:34.017340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:34.178539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9698-2c81-4d2f-8f59-38e3262efbc5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:34.240929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:34.247665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9690f-2993-4531-8172-acaf287486e4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:34.253062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:34.255458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:34.260648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:34.261124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:34.315969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:34.316567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:34.319418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:34.319790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:34.327796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:34.327796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:34.328086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 130/265] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:34 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:34.341420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:34.376938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:34.378667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:34.414323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:34.533010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee89f-ea4d-42be-bbfc-3519b8655a76 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:34.563931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 136/266] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:34.569732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:34.601421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:34.602268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:34.602770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:34.603311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:34.604856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] RBAC: Adding query filter params (role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=0d3d6c05cbfb4e06a78269570b02cb97) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:34.605498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:34.608994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:34.623049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 131/267] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:34 2022] GET /identity/v3/role_assignments?user.id=0d3d6c05cbfb4e06a78269570b02cb97&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:34.626881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:34.719898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c266-682e-4b0b-9df7-b1c109244951 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:34.769139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79c2a3-d492-4d95-8222-ab7fd80cc91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:34.770126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c2a3-d492-4d95-8222-ab7fd80cc91c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:34.770621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c2a3-d492-4d95-8222-ab7fd80cc91c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:34.771030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c2a3-d492-4d95-8222-ab7fd80cc91c None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:34.774216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79c2a3-d492-4d95-8222-ab7fd80cc91c None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:34.775967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79c2a3-d492-4d95-8222-ab7fd80cc91c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:34.777989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 137/268] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:34 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:34.784223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:34.928131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bc74-8855-419e-8991-4760e96c4ed7 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:34.928699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bc74-8855-419e-8991-4760e96c4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:34.928699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bc74-8855-419e-8991-4760e96c4ed7 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:34.930406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 138/269] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:34.937121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:34.941048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e6325-7b4a-4ac0-9de5-86ee0889544f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:34.941771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f4760-fcae-4a30-8b1c-24189613e06c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:34.942082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f4760-fcae-4a30-8b1c-24189613e06c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:34.942502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f4760-fcae-4a30-8b1c-24189613e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:34.985607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c74f4760-fcae-4a30-8b1c-24189613e06c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:34.986871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c74f4760-fcae-4a30-8b1c-24189613e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:34.987846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a4aa5-0517-47d0-ba10-3630c5dc46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:34.988530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4aa5-0517-47d0-ba10-3630c5dc46fe None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:34.989012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4aa5-0517-47d0-ba10-3630c5dc46fe None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:34.989294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4aa5-0517-47d0-ba10-3630c5dc46fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:34.990031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a4aa5-0517-47d0-ba10-3630c5dc46fe None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=0d3d6c05cbfb4e06a78269570b02cb97) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:34.990337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a4aa5-0517-47d0-ba10-3630c5dc46fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:34.991789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a4aa5-0517-47d0-ba10-3630c5dc46fe None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:34.999937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 132/270] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:34 2022] GET /identity/v3/role_assignments?user.id=0d3d6c05cbfb4e06a78269570b02cb97&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:35.001262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64c230-af80-4b9a-ac17-6d83997df38b None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.001543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64c230-af80-4b9a-ac17-6d83997df38b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.001820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64c230-af80-4b9a-ac17-6d83997df38b None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.003274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 133/271] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:35.010017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7565e-1171-4724-b9ef-a6991ea0918a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.010718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7565e-1171-4724-b9ef-a6991ea0918a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.011002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7565e-1171-4724-b9ef-a6991ea0918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.034964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1fe7565e-1171-4724-b9ef-a6991ea0918a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:35.036802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1fe7565e-1171-4724-b9ef-a6991ea0918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:35.140432 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 139/272] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:35.141468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 134/273] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:35.352816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35ff3-047d-4e2c-9c29-5de0a3e47dc6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.353095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35ff3-047d-4e2c-9c29-5de0a3e47dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.353371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35ff3-047d-4e2c-9c29-5de0a3e47dc6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.354996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 140/274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:35.360544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e1c07-3ce1-49fd-9534-0a0e97be6055 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.361067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e1c07-3ce1-49fd-9534-0a0e97be6055 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.361528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e1c07-3ce1-49fd-9534-0a0e97be6055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.380781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a91e1c07-3ce1-49fd-9534-0a0e97be6055 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:35.382238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a91e1c07-3ce1-49fd-9534-0a0e97be6055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:35.432528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35ff3-047d-4e2c-9c29-5de0a3e47dc6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:35.471442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:35.475880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 135/275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:35.510561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e1c07-3ce1-49fd-9534-0a0e97be6055 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:35.538311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:35.570239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35ff3-047d-4e2c-9c29-5de0a3e47dc6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:35.606465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:35.607093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.607367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.607634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.608890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:35.610467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:35.617277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 141/276] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:35.618701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e1c07-3ce1-49fd-9534-0a0e97be6055 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:35.619583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:35.661074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:35.661714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.661987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.662253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.680375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:35.686649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:35.687557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:35.688453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 136/277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:14:35.694617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:35.737538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494f515-fd1e-4c50-a65e-1d4f8b6de881 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:35.740629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:35.774835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:35.775445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.775725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.776010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.776694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:35.778147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:35.803320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 142/278] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:14:35 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:14:35.803320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:35.808844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:35.833279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab4f4a-238f-4480-8707-a6eb1f1feec2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:35.886087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:35.886921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:35.887273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:35.887621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:35.888557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] RBAC: Adding query filter params (name=member) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:35.888937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:35.890443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:35.906602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 137/279] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:35.908698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:35.967790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7409e-ea46-4d50-b1fd-e18b90b58dc4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:36.021419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:36.022133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:36.022419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:36.022698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:36.029975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaee7a-49c3-4190-b66c-b09f3608959f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:36.040873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:36.052494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:36.054413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:36.056222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:36.059783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 143/280] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:36.068962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:36.078947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:36.079615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:36.079895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:36.080168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] PATH_INFO: `/v3/users/d80838a80eef4b1498f19c48515b89e8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:36.094260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:36.099643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] RBAC: Authorizing `identity:get_user(user_id=d80838a80eef4b1498f19c48515b89e8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:36.101184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:36.102877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 138/281] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:35 2022] GET /identity/v3/users/d80838a80eef4b1498f19c48515b89e8 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:36.109470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:36.115446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:36.209774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd3519-c204-447d-aeab-e7d1e59e4ff2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:36.244876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e06de-59fd-42fa-ae29-06f79b9fbd12 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:36.250703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:36.251618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:36.252097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:36.252608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:36.253569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:36.254068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:36.255799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:36.265360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 144/282] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:36.271862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:36.286056 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:36.286973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:36.287813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:36.288311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:36.289570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, user.id=d80838a80eef4b1498f19c48515b89e8, scope.system=all) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:36.290328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:36.292010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:36.297909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 139/283] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 05:14:36 2022] GET /identity/v3/role_assignments?user.id=d80838a80eef4b1498f19c48515b89e8&scope.system=all&role.id=75d345ed873a4df3be5afc217fb2676f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:36.371535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:36.402925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805a78-29c7-458b-bfb9-a2c619431aca None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:36.441650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:36.442682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:36.443139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:36.443581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] PATH_INFO: `/v3/users/793c37b6f89a4e71ab3f1a79c0938e01` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:36.445108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] RBAC: Authorizing `identity:get_user(user_id=793c37b6f89a4e71ab3f1a79c0938e01)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:36.446826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:36.448733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 145/284] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:36 2022] GET /identity/v3/users/793c37b6f89a4e71ab3f1a79c0938e01 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:36.456240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:36.556382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:36.588559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a0b32-e79d-4f90-8f0c-d75f57e6727c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:36.624692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc4c3d-e73e-4f20-8d20-a62250e91efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:36.626390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4c3d-e73e-4f20-8d20-a62250e91efe None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:36.626390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4c3d-e73e-4f20-8d20-a62250e91efe None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:36.626390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4c3d-e73e-4f20-8d20-a62250e91efe None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:36.627060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc4c3d-e73e-4f20-8d20-a62250e91efe None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:36.628546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc4c3d-e73e-4f20-8d20-a62250e91efe None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:36.635315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 140/285] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:36 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:36.640000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:36.839299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc059db-2e97-40c7-bb36-e700c9f75229 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:36.891014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63110ef-45c4-4c62-9fe1-f7280af1421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:36.891687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63110ef-45c4-4c62-9fe1-f7280af1421d None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:36.891973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63110ef-45c4-4c62-9fe1-f7280af1421d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:36.892253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63110ef-45c4-4c62-9fe1-f7280af1421d None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/793c37b6f89a4e71ab3f1a79c0938e01/roles/dfa8f9e26cf14ca9ad2e0e641fcbf2e6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:36.895976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63110ef-45c4-4c62-9fe1-f7280af1421d None admin] RBAC: Authorizing `identity:create_grant(project_id=0866ec7b5e9f4d4c947e6a65533662f7, user_id=793c37b6f89a4e71ab3f1a79c0938e01, role_id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:36.898652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63110ef-45c4-4c62-9fe1-f7280af1421d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:36.917353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 146/286] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:14:36 2022] PUT /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/users/793c37b6f89a4e71ab3f1a79c0938e01/roles/dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:14:37.017814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b88a3-0746-4883-a37b-a68945127ea9 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:37.018314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b88a3-0746-4883-a37b-a68945127ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:37.018386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b88a3-0746-4883-a37b-a68945127ea9 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:37.019957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 141/287] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:37.025700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a5c3-25ea-48e2-969e-3c20a21843cd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:37.026209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a5c3-25ea-48e2-969e-3c20a21843cd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:37.026466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a5c3-25ea-48e2-969e-3c20a21843cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:37.034614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:37.049136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-da49a5c3-25ea-48e2-969e-3c20a21843cd None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:37.050752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-da49a5c3-25ea-48e2-969e-3c20a21843cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:37.159102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 147/288] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:37.485127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b88a3-0746-4883-a37b-a68945127ea9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:37.596953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b88a3-0746-4883-a37b-a68945127ea9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:37.632627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:37.633265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:37.633545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:37.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:37.636576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:37.644839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:37.650304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:37.651155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:37.651962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 142/289] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:37.657226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a5c3-25ea-48e2-969e-3c20a21843cd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:37.786368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a5c3-25ea-48e2-969e-3c20a21843cd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:37.833859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:37.834818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:37.835315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:37.835786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:37.836665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:37.837184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:37.838747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:37.840345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:37.862332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 148/290] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:37.869424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:38.010165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5d302-7124-4600-9fc3-8561f0695b4b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:38.045088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:38.045691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:38.045960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:38.046191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] PATH_INFO: `/v3/users/76981f7b6f2d4f08b708716ac9a67293` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:38.047459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] RBAC: Authorizing `identity:get_user(user_id=76981f7b6f2d4f08b708716ac9a67293)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:38.048946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:38.050896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 143/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:37 2022] GET /identity/v3/users/76981f7b6f2d4f08b708716ac9a67293 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:38.056936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:38.172235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bf6c7-291d-4215-85f4-bcb04b3e84c6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:38.218291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0bbec-9af8-4f4f-828d-7fcfcd53247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:38.218900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0bbec-9af8-4f4f-828d-7fcfcd53247b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:38.219176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0bbec-9af8-4f4f-828d-7fcfcd53247b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:38.219448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0bbec-9af8-4f4f-828d-7fcfcd53247b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:38.297458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:38.309228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0bbec-9af8-4f4f-828d-7fcfcd53247b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:38.310691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0bbec-9af8-4f4f-828d-7fcfcd53247b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:38.422450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 149/292] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:38.429686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:38.539774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:38.592767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f059252-d9a1-49a2-adf1-7e49ff964670 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:38.629761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729333b6-dae3-4468-a5af-1e11a5edfc6a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:38.630399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729333b6-dae3-4468-a5af-1e11a5edfc6a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:38.630989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729333b6-dae3-4468-a5af-1e11a5edfc6a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:38.632671 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 150/293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:38.638166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f9bc-4489-46d1-b19c-769e6236cd10 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:38.638686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f9bc-4489-46d1-b19c-769e6236cd10 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:38.639144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f9bc-4489-46d1-b19c-769e6236cd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:38.652458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:38.653397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:38.653888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:38.654351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:38.655795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:38.657489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:38.659459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 144/294] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:38 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:38.666150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:38.667588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-feb5f9bc-4489-46d1-b19c-769e6236cd10 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:38.669319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-feb5f9bc-4489-46d1-b19c-769e6236cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:38.808576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 151/295] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:38.841043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734e54f-38e7-4848-908d-fcee559dcd4b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:38.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:38.883490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004fc20-69ed-43d5-87a9-1738b5e42095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:38.884096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004fc20-69ed-43d5-87a9-1738b5e42095 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:38.884402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004fc20-69ed-43d5-87a9-1738b5e42095 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:38.884681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004fc20-69ed-43d5-87a9-1738b5e42095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:38.885403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004fc20-69ed-43d5-87a9-1738b5e42095 None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=76981f7b6f2d4f08b708716ac9a67293) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:38.885708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004fc20-69ed-43d5-87a9-1738b5e42095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:38.887133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004fc20-69ed-43d5-87a9-1738b5e42095 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:38.893445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 145/296] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:38 2022] GET /identity/v3/role_assignments?user.id=76981f7b6f2d4f08b708716ac9a67293&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=75d345ed873a4df3be5afc217fb2676f => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:39.101305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5f9bc-4489-46d1-b19c-769e6236cd10 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:39.136804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:39.187897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff813-715d-4692-9e99-0d0075d00ba7 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.188468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff813-715d-4692-9e99-0d0075d00ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.188468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff813-715d-4692-9e99-0d0075d00ba7 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.189803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 146/297] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:39.195982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c79e0-bee6-4c07-a493-f98a1aaa4541 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.196323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c79e0-bee6-4c07-a493-f98a1aaa4541 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.196631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c79e0-bee6-4c07-a493-f98a1aaa4541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.222837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8e6c79e0-bee6-4c07-a493-f98a1aaa4541 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:39.224107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8e6c79e0-bee6-4c07-a493-f98a1aaa4541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:39.244074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5f9bc-4489-46d1-b19c-769e6236cd10 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:39.291634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b008a8-ca04-48b9-92ee-84f12a0f561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:39.292296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b008a8-ca04-48b9-92ee-84f12a0f561f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.292587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b008a8-ca04-48b9-92ee-84f12a0f561f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.292864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b008a8-ca04-48b9-92ee-84f12a0f561f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.312705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b008a8-ca04-48b9-92ee-84f12a0f561f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-06b008a8-ca04-48b9-92ee-84f12a0f561f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:39.318226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:39.319108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:39.319908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:39.320976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 152/298] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:39.322243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2083db-f0ca-4eb9-ba7d-08c4859cb3c5 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.322527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2083db-f0ca-4eb9-ba7d-08c4859cb3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.322800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2083db-f0ca-4eb9-ba7d-08c4859cb3c5 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.323913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 147/299] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:39.325237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c79e0-bee6-4c07-a493-f98a1aaa4541 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:39.330973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 153/300] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:39.335756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cbc75-958d-4660-a9d8-a12fa4bfea3a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.335756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cbc75-958d-4660-a9d8-a12fa4bfea3a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.335756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cbc75-958d-4660-a9d8-a12fa4bfea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.355675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cf9cbc75-958d-4660-a9d8-a12fa4bfea3a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:39.356899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cf9cbc75-958d-4660-a9d8-a12fa4bfea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:39.455225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 154/301] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:39.460149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c79e0-bee6-4c07-a493-f98a1aaa4541 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:39.486715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:39.496712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:39.497705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.498294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.498565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.499232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:39.499530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:39.499530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:39.511698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 148/302] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:39.518819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cbc75-958d-4660-a9d8-a12fa4bfea3a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:39.550235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:39.625204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cbc75-958d-4660-a9d8-a12fa4bfea3a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:39.626440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:39.663693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:39.664535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.664824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.665216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] PATH_INFO: `/v3/users/7e277dd152de49c8acabd5856f796e3c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.681296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] RBAC: Authorizing `identity:get_user(user_id=7e277dd152de49c8acabd5856f796e3c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:39.683021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:39.684714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 155/303] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:39 2022] GET /identity/v3/users/7e277dd152de49c8acabd5856f796e3c => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:39.690245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:39.740443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268e34-236a-4b4a-9576-e0f0af808064 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:39.778770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:39.781079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:39.781706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.782310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.782721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.796539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:39.803895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:39.804848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:39.805667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 149/304] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:39.806425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:39.813267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115219e6-ebc1-4308-96d5-6ef72feafbff None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:39.862398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:39.863307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.864373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.864790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.865616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] RBAC: Adding query filter params (role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6, user.id=7e277dd152de49c8acabd5856f796e3c, scope.system=all) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:39.866034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:39.867369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:39.868628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:39.873331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 156/305] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 05:14:39 2022] GET /identity/v3/role_assignments?user.id=7e277dd152de49c8acabd5856f796e3c&scope.system=all&role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:39.877718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:39.949923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf600a-c701-4c04-8c54-9ff3e00ac6f2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:39.991717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:39.992303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:39.992599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:39.992874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:39.994068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:39.995747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:39.997757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 150/306] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:40.003486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:40.012614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69c61d-98d6-4024-ae57-d62f859acff4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:40.048930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967cd9-feab-416c-b751-73f6aaf86fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:40.049553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967cd9-feab-416c-b751-73f6aaf86fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.049828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967cd9-feab-416c-b751-73f6aaf86fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.050100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967cd9-feab-416c-b751-73f6aaf86fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.050760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967cd9-feab-416c-b751-73f6aaf86fa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:40.051123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967cd9-feab-416c-b751-73f6aaf86fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:40.053131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967cd9-feab-416c-b751-73f6aaf86fa1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:40.058851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:40.062803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 157/307] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:40.067217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800c47-d916-4f07-92e9-24f180d4f65b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.067217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800c47-d916-4f07-92e9-24f180d4f65b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.067217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800c47-d916-4f07-92e9-24f180d4f65b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.068407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 158/308] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:40.069386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c800c47-d916-4f07-92e9-24f180d4f65b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:40.120689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bdbb8-ebaf-4e46-aa5b-f0bd118a99e2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:40.137351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:40.160263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d7f83-3e33-499c-882a-de8622828047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:40.161708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7f83-3e33-499c-882a-de8622828047 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.161992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7f83-3e33-499c-882a-de8622828047 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.162266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7f83-3e33-499c-882a-de8622828047 None admin] PATH_INFO: `/v3/groups` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.162913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d7f83-3e33-499c-882a-de8622828047 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:40.164812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d7f83-3e33-499c-882a-de8622828047 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:40.181081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c800c47-d916-4f07-92e9-24f180d4f65b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:40.188703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 151/309] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 21 05:14:40 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:14:40.188703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23c8c8-673e-4946-9566-4d9d19fc5b1c None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.188703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23c8c8-673e-4946-9566-4d9d19fc5b1c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.188703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23c8c8-673e-4946-9566-4d9d19fc5b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.215394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8a23c8c8-673e-4946-9566-4d9d19fc5b1c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:40.216980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8a23c8c8-673e-4946-9566-4d9d19fc5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:40.224400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:40.225251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.225623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.226012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] PATH_INFO: `/v3/users/d80838a80eef4b1498f19c48515b89e8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.228099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] RBAC: Authorizing `identity:get_user(user_id=d80838a80eef4b1498f19c48515b89e8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:40.230316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:40.232979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 159/310] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:40 2022] GET /identity/v3/users/d80838a80eef4b1498f19c48515b89e8 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:40.238807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:40.317096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 152/311] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:40.318573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:40.357308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baf15c-c88d-43e6-baa8-2e246457a282 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:40.397528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:40.398599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.399115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.399593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] PATH_INFO: `/v3/system/users/d80838a80eef4b1498f19c48515b89e8/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.401230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d80838a80eef4b1498f19c48515b89e8, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:40.402812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:40.415663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 160/312] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 21 05:14:40 2022] PUT /identity/v3/system/users/d80838a80eef4b1498f19c48515b89e8/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:14:40.602691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23c8c8-673e-4946-9566-4d9d19fc5b1c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:40.705324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23c8c8-673e-4946-9566-4d9d19fc5b1c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:40.713358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:40.743431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:40.744125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.744439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.744712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.756319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:40.761150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:40.762016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:40.762784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 153/313] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:40.768646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:40.881451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66616f97-a32f-4f9b-89ed-17583100bd1b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:40.911209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:40.916944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:40.917816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:40.918308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:40.918766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:40.919606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:40.920096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:40.921682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:40.932886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 161/314] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:40.939369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:41.039156 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0db17b-92d4-47e1-bc58-a2901b823266 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:41.073620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:41.074635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:41.075106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:41.075571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] PATH_INFO: `/v3/users/793c37b6f89a4e71ab3f1a79c0938e01` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:41.076902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=793c37b6f89a4e71ab3f1a79c0938e01)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:41.078526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:41.080411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 154/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:40 2022] GET /identity/v3/users/793c37b6f89a4e71ab3f1a79c0938e01 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:41.089392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:41.199595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09316-0111-4321-8329-1d6f649d6342 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:41.236429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:41.237427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:41.237936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:41.238461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:41.303613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:41.312152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:41.314718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:41.420047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 162/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:41.429371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:41.462801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:41.528688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35541826-5b94-486f-9f30-839f3415e3b8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:41.563893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c983d7d-ecbe-48c7-b219-d84056586536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:41.564549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c983d7d-ecbe-48c7-b219-d84056586536 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:41.564826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c983d7d-ecbe-48c7-b219-d84056586536 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:41.565100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c983d7d-ecbe-48c7-b219-d84056586536 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:41.566222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c983d7d-ecbe-48c7-b219-d84056586536 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:41.567680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c983d7d-ecbe-48c7-b219-d84056586536 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:41.569495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 155/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:41 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:41.575112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:41.670747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:41.678422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1eaa0-06ef-4c37-9cac-ad3e9cb89b1a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:41.717478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b2f39-dc89-41dc-837b-b88f2c221e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:41.718011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b2f39-dc89-41dc-837b-b88f2c221e96 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:41.718291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b2f39-dc89-41dc-837b-b88f2c221e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:41.718564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b2f39-dc89-41dc-837b-b88f2c221e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:41.719288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b2f39-dc89-41dc-837b-b88f2c221e96 None admin] RBAC: Adding query filter params (role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7, user.id=793c37b6f89a4e71ab3f1a79c0938e01) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:41.719594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b2f39-dc89-41dc-837b-b88f2c221e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:41.721105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b2f39-dc89-41dc-837b-b88f2c221e96 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:41.727416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 163/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:14:41 2022] GET /identity/v3/role_assignments?user.id=793c37b6f89a4e71ab3f1a79c0938e01&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:42.079136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de2dfe-3194-406a-81eb-5d59bdc41c71 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.079471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de2dfe-3194-406a-81eb-5d59bdc41c71 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.079639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de2dfe-3194-406a-81eb-5d59bdc41c71 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.081033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 156/319] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:42.086140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b87dc-f054-4c31-9969-4a8b9079d38e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.086426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b87dc-f054-4c31-9969-4a8b9079d38e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.086699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b87dc-f054-4c31-9969-4a8b9079d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.105144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ff8b87dc-f054-4c31-9969-4a8b9079d38e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:42.106332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ff8b87dc-f054-4c31-9969-4a8b9079d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:42.173950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 164/320] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:42.441477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de2dfe-3194-406a-81eb-5d59bdc41c71 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:42.546845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de2dfe-3194-406a-81eb-5d59bdc41c71 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:42.548394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:42.560176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ce353-f8f5-4a02-ae70-ca8c6978a8fc None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.560693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ce353-f8f5-4a02-ae70-ca8c6978a8fc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.560799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ce353-f8f5-4a02-ae70-ca8c6978a8fc None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.562058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 165/321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:42.567608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb6af-2360-4530-8181-b2f49dd46693 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.567892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb6af-2360-4530-8181-b2f49dd46693 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.568166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb6af-2360-4530-8181-b2f49dd46693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.585159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:42.585801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.586077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.586350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.586576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ea1fb6af-2360-4530-8181-b2f49dd46693 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:42.587877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ea1fb6af-2360-4530-8181-b2f49dd46693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:42.598927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:42.603961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:42.605098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:42.605899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 157/322] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:42.611370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:42.665609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 166/323] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:42.717378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f7f9c-00b9-413d-89ff-0da9783227a9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.717641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f7f9c-00b9-413d-89ff-0da9783227a9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.717854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f7f9c-00b9-413d-89ff-0da9783227a9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.718740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab66b3-897c-4489-b588-03e3622c64dc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:42.719316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 167/324] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:42.724003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f681d-0f82-4974-a97c-1941015bea93 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.724301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f681d-0f82-4974-a97c-1941015bea93 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.724614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f681d-0f82-4974-a97c-1941015bea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.742365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1f0f681d-0f82-4974-a97c-1941015bea93 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:42.743601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1f0f681d-0f82-4974-a97c-1941015bea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:42.755758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:42.756312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.756597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.756869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.757531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:42.757835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:42.758000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:42.759218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:42.772326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 158/325] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:42.774167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:42.799809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:42.820719 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 168/326] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:42.875352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889dd8-5ea7-4241-8e3c-789443f2967a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:42.909319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:42.909956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:42.910235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:42.910554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] PATH_INFO: `/v3/users/7e277dd152de49c8acabd5856f796e3c` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:42.911674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e277dd152de49c8acabd5856f796e3c)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:42.913153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:42.914918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 159/327] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:42 2022] GET /identity/v3/users/7e277dd152de49c8acabd5856f796e3c => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:42.920349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f681d-0f82-4974-a97c-1941015bea93 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:42.928846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:43.023006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:43.031191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f681d-0f82-4974-a97c-1941015bea93 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:43.033299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418ec3-b4ef-4e3a-b200-6d57df074bf7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:43.066510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:43.067761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:43.068006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:43.068295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] PATH_INFO: `/v3/system/users/7e277dd152de49c8acabd5856f796e3c/roles/dfa8f9e26cf14ca9ad2e0e641fcbf2e6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:43.069420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:43.069667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7e277dd152de49c8acabd5856f796e3c, role_id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:43.070196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:43.070544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:43.070887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:43.071037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:43.072103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:43.073640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:43.076369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 160/328] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:43.078915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 169/329] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 21 05:14:42 2022] PUT /identity/v3/system/users/7e277dd152de49c8acabd5856f796e3c/roles/dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:43.082446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:43.095305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:43.111197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:43.203579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ed87-abf0-4c73-b46a-6506885869e3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:43.210456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2602f-d440-4ac0-9ad5-21f90aa5263c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:43.242706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:43.243331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:43.243611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:43.243883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] PATH_INFO: `/v3/groups` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:43.244558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:43.245013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:43.245646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:43.245925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:43.246015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:43.246194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:43.260994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:43.266076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 161/330] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 21 05:14:43 2022] POST /identity/v3/groups => generated 226 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:43.266342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:43.267535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:43.268583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 170/331] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:14:43.275709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:43.300038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:43.386580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065f4f5-edbf-45f5-802c-d8c9e290a022 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:43.422147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:43.422777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:43.423053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:43.423322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:43.424000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] RBAC: Adding query filter params (name=member) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:43.424322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:43.425727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:43.440081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 162/332] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:43.441821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:43.525355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:43.560486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fa26-9441-4d86-8e41-cb33a757abfc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:43.598818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88fce1-8025-42f9-86f4-eba6224c0f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:43.599457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fce1-8025-42f9-86f4-eba6224c0f0a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:43.599740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fce1-8025-42f9-86f4-eba6224c0f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:43.600014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fce1-8025-42f9-86f4-eba6224c0f0a None admin] PATH_INFO: `/v3/users/d80838a80eef4b1498f19c48515b89e8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:43.601196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88fce1-8025-42f9-86f4-eba6224c0f0a None admin] RBAC: Authorizing `identity:get_user(user_id=d80838a80eef4b1498f19c48515b89e8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:43.602659 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88fce1-8025-42f9-86f4-eba6224c0f0a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:43.604243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 171/333] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:43 2022] GET /identity/v3/users/d80838a80eef4b1498f19c48515b89e8 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:43.610121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:43.697295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:43.716832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257bf4-5b6f-447e-8874-62dcc4fce32b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:43.752968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d755bf-133d-46a7-9108-38b537ddf11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:43.753606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d755bf-133d-46a7-9108-38b537ddf11c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:43.753868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d755bf-133d-46a7-9108-38b537ddf11c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:43.754179 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d755bf-133d-46a7-9108-38b537ddf11c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:43.754913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d755bf-133d-46a7-9108-38b537ddf11c None admin] RBAC: Adding query filter params (role.id=75d345ed873a4df3be5afc217fb2676f, user.id=d80838a80eef4b1498f19c48515b89e8, scope.system=all) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:43.755227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d755bf-133d-46a7-9108-38b537ddf11c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:43.756709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d755bf-133d-46a7-9108-38b537ddf11c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:43.769341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 163/334] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 05:14:43 2022] GET /identity/v3/role_assignments?user.id=d80838a80eef4b1498f19c48515b89e8&scope.system=all&role.id=75d345ed873a4df3be5afc217fb2676f => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:45.697340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7609c-483c-472e-a60f-d6adfff7358b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:45.697855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7609c-483c-472e-a60f-d6adfff7358b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:45.697954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7609c-483c-472e-a60f-d6adfff7358b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:45.699655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 172/335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:45.708166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b628-d87e-4323-a67a-41d7e4b60a23 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:45.709038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b628-d87e-4323-a67a-41d7e4b60a23 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:45.709455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b628-d87e-4323-a67a-41d7e4b60a23 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:45.710957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 164/336] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:45.715785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b941a13-2bb1-4b21-bb70-57c2d1748611 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:45.716330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b941a13-2bb1-4b21-bb70-57c2d1748611 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:45.716804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b941a13-2bb1-4b21-bb70-57c2d1748611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:45.727074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0c1d3-6904-43f6-9d03-19d2a09e3c11 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:45.734132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0c1d3-6904-43f6-9d03-19d2a09e3c11 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:45.734775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0c1d3-6904-43f6-9d03-19d2a09e3c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:45.752751 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8b941a13-2bb1-4b21-bb70-57c2d1748611 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:45.756990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8b941a13-2bb1-4b21-bb70-57c2d1748611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:45.780096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-93c0c1d3-6904-43f6-9d03-19d2a09e3c11 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:45.788752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-93c0c1d3-6904-43f6-9d03-19d2a09e3c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:45.925368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 173/337] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:45.943731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 165/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:46.003366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1e2c4-3561-4736-ac5d-fa868799b7c2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:46.003650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1e2c4-3561-4736-ac5d-fa868799b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:46.003848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1e2c4-3561-4736-ac5d-fa868799b7c2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:46.005557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 174/339] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:46.013676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855a48-fad0-4aaf-b81a-76350f6d27c4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:46.014153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855a48-fad0-4aaf-b81a-76350f6d27c4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:46.014573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855a48-fad0-4aaf-b81a-76350f6d27c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:46.041266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-50855a48-fad0-4aaf-b81a-76350f6d27c4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:46.042677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-50855a48-fad0-4aaf-b81a-76350f6d27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:46.118789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:46.124490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 166/340] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:46.320704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1e2c4-3561-4736-ac5d-fa868799b7c2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:46.404777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:46.445429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1e2c4-3561-4736-ac5d-fa868799b7c2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:46.465557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50855a48-fad0-4aaf-b81a-76350f6d27c4 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:46.522067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:46.522945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:46.524212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:46.525728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:46.548432 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:46.559115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:46.560185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 05:14:46.561145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:46.572717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 175/341] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:46.609696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:46.654267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50855a48-fad0-4aaf-b81a-76350f6d27c4 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:46.748111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1355-f16a-4a2c-a360-20cb6eb6e1b3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:46.760350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:46.761013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:46.761294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:46.761567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:46.781282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:46.786744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:46.787610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:46.788475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:46.793359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 167/342] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:14:46.799040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:46.820662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:46.827874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:46.828460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:46.828745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:46.829026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:46.829707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:46.830018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:46.831731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:46.854144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 176/343] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:46.855014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:46.906511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:46.955515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c6179-1645-43cc-9d34-322240ce884c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:46.987545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e79e-5794-45a1-bfaa-3291c526e4f1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:46.995515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:46.996165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:46.996504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:46.996785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.009574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:47.014600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:47.015473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:47.016291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 168/344] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:47.017023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:47.030511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d6c3-ee1c-4cef-bbf0-09cec43be6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:47.031130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d6c3-ee1c-4cef-bbf0-09cec43be6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.031411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d6c3-ee1c-4cef-bbf0-09cec43be6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.031687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d6c3-ee1c-4cef-bbf0-09cec43be6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.032386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d6c3-ee1c-4cef-bbf0-09cec43be6a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:47.032694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d6c3-ee1c-4cef-bbf0-09cec43be6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:47.034088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d6c3-ee1c-4cef-bbf0-09cec43be6a7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:47.042931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 177/345] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:47.048659 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35912d0f-b7fc-4233-b939-f45e97e9e365 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.048947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35912d0f-b7fc-4233-b939-f45e97e9e365 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.049225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35912d0f-b7fc-4233-b939-f45e97e9e365 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.050782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 178/346] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:47.052053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35912d0f-b7fc-4233-b939-f45e97e9e365 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:47.114423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:47.141230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a3a7b-eaf1-41a6-9820-96f6ca5ccabe None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:47.178921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:47.192579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35912d0f-b7fc-4233-b939-f45e97e9e365 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:47.200925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:47.201265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.201550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.201826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] PATH_INFO: `/v3/users/7e277dd152de49c8acabd5856f796e3c` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.202972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] RBAC: Authorizing `identity:get_user(user_id=7e277dd152de49c8acabd5856f796e3c)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:47.204480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:47.208360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 169/347] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:14:47 2022] GET /identity/v3/users/7e277dd152de49c8acabd5856f796e3c => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:47.209409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:47.244965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c98ba-7f40-46f7-95f0-cc6a551b7523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:47.245969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c98ba-7f40-46f7-95f0-cc6a551b7523 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.246455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c98ba-7f40-46f7-95f0-cc6a551b7523 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.246931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c98ba-7f40-46f7-95f0-cc6a551b7523 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.248255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c98ba-7f40-46f7-95f0-cc6a551b7523 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:47.248835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c98ba-7f40-46f7-95f0-cc6a551b7523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:47.253053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c98ba-7f40-46f7-95f0-cc6a551b7523 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:47.264096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 179/348] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:47.265853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16b14-00f2-4a34-8e25-48e548fbd697 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.266339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16b14-00f2-4a34-8e25-48e548fbd697 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.266909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16b14-00f2-4a34-8e25-48e548fbd697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.288455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-96e16b14-00f2-4a34-8e25-48e548fbd697 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:47.290023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-96e16b14-00f2-4a34-8e25-48e548fbd697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:47.331923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59b7a-bfd6-46ce-9f09-3984730a4bbe None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:47.370961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 180/349] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:47.372408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16b14-00f2-4a34-8e25-48e548fbd697 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:47.374061 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a1196-4ef5-4027-9f7b-1ff9742aeabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:47.374661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a1196-4ef5-4027-9f7b-1ff9742aeabb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.374944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a1196-4ef5-4027-9f7b-1ff9742aeabb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.375219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a1196-4ef5-4027-9f7b-1ff9742aeabb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.427810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:47.444078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:47.459936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a1196-4ef5-4027-9f7b-1ff9742aeabb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:47.461745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a1196-4ef5-4027-9f7b-1ff9742aeabb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:47.489841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16b14-00f2-4a34-8e25-48e548fbd697 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:47.531625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:47.532319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.532691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.533000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.534032 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] RBAC: Adding query filter params (role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6, user.id=7e277dd152de49c8acabd5856f796e3c, scope.system=all) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:47.534345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:47.536806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:47.554361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 181/350] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 21 05:14:47 2022] GET /identity/v3/role_assignments?user.id=7e277dd152de49c8acabd5856f796e3c&scope.system=all&role.id=dfa8f9e26cf14ca9ad2e0e641fcbf2e6 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:47.555205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:47.606654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 170/351] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:47.608006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228d46-3abc-4a9c-b472-2fece73bea39 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.608308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228d46-3abc-4a9c-b472-2fece73bea39 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.608593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228d46-3abc-4a9c-b472-2fece73bea39 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.610076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 171/352] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:47.610794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7228d46-3abc-4a9c-b472-2fece73bea39 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:47.726775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd04fe-80aa-4d03-ba56-19b2d2215dea None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:47.730279 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:47.755430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:47.775788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7228d46-3abc-4a9c-b472-2fece73bea39 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:47.783602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:47.785315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.785746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.786194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.819922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f841418-03b5-4079-b70f-d084ae2e5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:47.820592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841418-03b5-4079-b70f-d084ae2e5e60 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.820935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841418-03b5-4079-b70f-d084ae2e5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.821210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841418-03b5-4079-b70f-d084ae2e5e60 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.822332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841418-03b5-4079-b70f-d084ae2e5e60 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:47.823767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841418-03b5-4079-b70f-d084ae2e5e60 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:47.825612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 172/353] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:47 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:47.826549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406711ee-b205-4391-adb8-bb285af6ee4a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:47.826826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406711ee-b205-4391-adb8-bb285af6ee4a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:47.827094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406711ee-b205-4391-adb8-bb285af6ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:47.847448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-406711ee-b205-4391-adb8-bb285af6ee4a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:47.848737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-406711ee-b205-4391-adb8-bb285af6ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:47.881573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:47.883190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:47.938807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 173/354] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:47.939960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406711ee-b205-4391-adb8-bb285af6ee4a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.017564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 182/355] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:48.018710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.023285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.054155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.074984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406711ee-b205-4391-adb8-bb285af6ee4a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.120854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.120854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.120854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.120854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.134005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:48.139464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:48.140402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:48.141196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:48.143568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 174/356] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:48.144653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.159357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd103d-8cbe-46c2-959a-c768fc68540b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.198830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.199470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.199775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.200049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.206887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:48.208518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:48.210382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 183/357] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:48.211131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.258858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041ad4f-1e0e-4f51-ae72-2a7a47ef8f43 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.291178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.307326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.308189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.308633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.310341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.311039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:48.312601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:48.314748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 175/358] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:48.315962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.336726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.344140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709351-30da-4a5d-aeb3-ec7e1a858fe1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.392067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.392727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.393157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.393554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.394231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:48.394534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:48.396502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:48.406431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 184/359] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:48.407360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.446469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c85c-5fd4-47fe-9942-e3e26629b65e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.483143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.483754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.484036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.485036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.485142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=3a55b29c3502461cb780f9a3ce844b88) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:48.485376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:48.486797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:48.492816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 176/360] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=75d345ed873a4df3be5afc217fb2676f => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:48.493447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.531113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866986-f31c-4df2-b05e-fc0ac1a2321d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.564805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.574371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f267cff-ece1-455f-bc54-1f1942fa15d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.575223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f267cff-ece1-455f-bc54-1f1942fa15d0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.575503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f267cff-ece1-455f-bc54-1f1942fa15d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.575772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f267cff-ece1-455f-bc54-1f1942fa15d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.589395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f267cff-ece1-455f-bc54-1f1942fa15d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8f267cff-ece1-455f-bc54-1f1942fa15d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:48.595486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:48.596738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:48.597562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 185/361] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:48.598289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833c56-93ee-4c57-9230-f1334c081004 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.598289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833c56-93ee-4c57-9230-f1334c081004 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.598406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833c56-93ee-4c57-9230-f1334c081004 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.600183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 186/362] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:48.601634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833c56-93ee-4c57-9230-f1334c081004 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.609470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.640187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398d18-25f3-47b7-ac8e-8c51c72e31c4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.684534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15117c-e93d-4d11-96bf-00a1f7bffc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.685173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15117c-e93d-4d11-96bf-00a1f7bffc12 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.685459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15117c-e93d-4d11-96bf-00a1f7bffc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.685731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15117c-e93d-4d11-96bf-00a1f7bffc12 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.687488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15117c-e93d-4d11-96bf-00a1f7bffc12 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:48.688986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15117c-e93d-4d11-96bf-00a1f7bffc12 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:48.690555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 177/363] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:48.691783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34dd17-9765-469b-acf6-b46299906f65 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.692079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34dd17-9765-469b-acf6-b46299906f65 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.692374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34dd17-9765-469b-acf6-b46299906f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.712740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ec34dd17-9765-469b-acf6-b46299906f65 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:48.713914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ec34dd17-9765-469b-acf6-b46299906f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:48.734267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833c56-93ee-4c57-9230-f1334c081004 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.775091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.775704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.776134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.776440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.797244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 178/364] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:48.798053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34dd17-9765-469b-acf6-b46299906f65 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:48.873356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.888208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:48.891097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:48.897359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:48.924654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34dd17-9765-469b-acf6-b46299906f65 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:48.973248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:48.974723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:48.975159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:48.975881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:48.976723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:48.977449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:48.979946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:48.991874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 179/365] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:48.993051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.020086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 187/366] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:49.021201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.116042 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a00dd-7319-46a6-aaf7-95c475b904b8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.143491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:49.150916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365826-8096-418d-9065-45bd6b1c8c27 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.156241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.156890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.157170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.158477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.158477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=3a55b29c3502461cb780f9a3ce844b88) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:49.158672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.161312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.166958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 180/367] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:48 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:49.167766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.172958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:49.204041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.204740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.205025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.205304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.301860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e624d-62bc-435c-8af3-d5a8da5d0cfa None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.308456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.310054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.350529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.351210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.351475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.351757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.352975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.355260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.357348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 181/368] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:49.358157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.439670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:49.447727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:49.452039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 188/369] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:49.458548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.500461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0710a-1da8-4164-ab4a-462bb44dc4a7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.547522 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.548192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.549053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.549334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.562445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:49.569689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:49.570772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 182/370] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:49.571663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.591080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb9bec-3c5e-41fe-aed3-67c5aaf77314 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.631712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.632045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.632248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.632571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.633761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.635326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.637343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 189/371] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:49.638121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.695054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc3e2e-f275-4741-b279-ca9571bc920a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.702213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:49.729319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:49.735771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.736752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.737231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.737752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.739260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.741850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.743783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 183/372] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:49.745050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.748235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848239e-385b-414c-8182-fbe8eb8ca6fa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.796982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.797261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.797993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.798660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:49.798963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.801682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.812446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 190/373] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:49.813875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.894123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b669e-9b79-42f8-9e75-d100d659fb84 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.935036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.935651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.935933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.936208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.936980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:49.937290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.938724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.940817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc1e4-4e3f-4366-b4c4-5a410ecf75e5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:49.945298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 184/374] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=75d345ed873a4df3be5afc217fb2676f => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:49.946068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:49.980710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:49.988321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:49.988987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:49.989273 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:49.989733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:49.991611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:49.993315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:49.995900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 191/375] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:50.002748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:50.042902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:50.095802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ed512-b320-4c51-8b36-146b4b466e2b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:50.135182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c49c4-55ad-4cf2-8c0c-ba22749f3b21 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:50.139911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:50.140919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:50.141197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:50.141469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:50.178564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:50.179185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:50.179469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:50.179746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:50.180508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:50.180819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:50.182276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:50.189678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 192/376] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:50 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:50.227087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:50.228516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:50.300480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:50.344585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 185/377] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:50.350074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:50.411674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:50.462132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040ae8-5aec-4408-9aec-15f8d33a337d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:50.496258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:50.496846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:50.497366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:50.497645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] PATH_INFO: `/v3/projects/f856f4ace59d412c839fff1b080f7b3c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:50.498860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] RBAC: Authorizing `identity:get_project(project_id=f856f4ace59d412c839fff1b080f7b3c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:50.500323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:50.502253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 193/378] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:50 2022] GET /identity/v3/projects/f856f4ace59d412c839fff1b080f7b3c => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:50.508078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:50.611590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88f167-2130-4b4c-8d67-85374985f8ac None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:50.647608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2c1be-4ebc-4c04-9582-492e8325c18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:50.648248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c1be-4ebc-4c04-9582-492e8325c18d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:50.648565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c1be-4ebc-4c04-9582-492e8325c18d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:50.648842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c1be-4ebc-4c04-9582-492e8325c18d None admin] PATH_INFO: `/v3/groups/69b0332a90184d2ca1ca33d6d7f0faf8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:50.655013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2c1be-4ebc-4c04-9582-492e8325c18d None admin] RBAC: Authorizing `identity:get_group(group_id=69b0332a90184d2ca1ca33d6d7f0faf8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:50.656517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2c1be-4ebc-4c04-9582-492e8325c18d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:50.658454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 186/379] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:50 2022] GET /identity/v3/groups/69b0332a90184d2ca1ca33d6d7f0faf8 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:50.664147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:50.777336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42bf8-1580-423b-8585-a70d062913db None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:50.798345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:50.814207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18f35-985f-4d9f-8644-506089560090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:50.814821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18f35-985f-4d9f-8644-506089560090 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:50.815096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18f35-985f-4d9f-8644-506089560090 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:50.815368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18f35-985f-4d9f-8644-506089560090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:50.816100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18f35-985f-4d9f-8644-506089560090 None admin] RBAC: Adding query filter params (group.id=69b0332a90184d2ca1ca33d6d7f0faf8, role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=f856f4ace59d412c839fff1b080f7b3c) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:50.816991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18f35-985f-4d9f-8644-506089560090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:50.818442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18f35-985f-4d9f-8644-506089560090 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:50.824458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 194/380] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:50 2022] GET /identity/v3/role_assignments?group.id=69b0332a90184d2ca1ca33d6d7f0faf8&scope.project.id=f856f4ace59d412c839fff1b080f7b3c&role.id=7407c800e8af41e2bc429a186be077ba => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:51.035867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820de0-5d4b-4429-9608-740be97599ef None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:51.036562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820de0-5d4b-4429-9608-740be97599ef None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:51.036562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820de0-5d4b-4429-9608-740be97599ef None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:51.037924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 187/381] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:51.044143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1abb7-9e24-4282-a2a1-3cb62345b26d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:51.044705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1abb7-9e24-4282-a2a1-3cb62345b26d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:51.044705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1abb7-9e24-4282-a2a1-3cb62345b26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:51.068818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7eb1abb7-9e24-4282-a2a1-3cb62345b26d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:51.070044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7eb1abb7-9e24-4282-a2a1-3cb62345b26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:51.155094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 195/382] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:51.466766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820de0-5d4b-4429-9608-740be97599ef None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:51.499822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:51.583154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820de0-5d4b-4429-9608-740be97599ef None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:51.625497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:51.626138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:51.626421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:51.626696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:51.637304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:51.645475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:51.647562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:51.648807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 188/383] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:51.655361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1abb7-9e24-4282-a2a1-3cb62345b26d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:51.816163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1abb7-9e24-4282-a2a1-3cb62345b26d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:51.833684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:51.862712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:51.863413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:51.863696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:51.863976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:51.864681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:51.864989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:51.866380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:51.878097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 196/384] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:51.884498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:52.009205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:52.028696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35952120-fe72-4f5d-ae85-5edae31aacb0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:52.069849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cc8ef-7111-4336-8983-b6bdf90f5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:52.070573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc8ef-7111-4336-8983-b6bdf90f5def None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:52.070735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc8ef-7111-4336-8983-b6bdf90f5def None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:52.070931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc8ef-7111-4336-8983-b6bdf90f5def None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:52.074201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cc8ef-7111-4336-8983-b6bdf90f5def None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:52.075656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cc8ef-7111-4336-8983-b6bdf90f5def None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:52.077631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 189/385] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:51 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:52.082983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:52.085529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1de06-a23a-4df2-aab6-629ce3398491 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:52.085822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1de06-a23a-4df2-aab6-629ce3398491 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:52.086099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1de06-a23a-4df2-aab6-629ce3398491 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:52.087755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 190/386] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:52.092818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a6b2-89bc-4408-94a8-6a2975dd4fd9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:52.093104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a6b2-89bc-4408-94a8-6a2975dd4fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:52.093380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a6b2-89bc-4408-94a8-6a2975dd4fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:52.115273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-9648a6b2-89bc-4408-94a8-6a2975dd4fd9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:52.116525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9648a6b2-89bc-4408-94a8-6a2975dd4fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:52.226366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 191/387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:52.263463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc69b5-d2df-4502-93ea-9a3244b6b0d7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:52.298962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:52.299600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:52.299889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:52.300163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:52.302072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:52.303599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:52.305640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 197/388] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:52 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:52.313668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a6b2-89bc-4408-94a8-6a2975dd4fd9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:52.429480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:52.446913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a6b2-89bc-4408-94a8-6a2975dd4fd9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:52.491710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:52.492447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:52.492891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:52.493312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88/groups/aae1d079803741ba8eb483f854a2dc83/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:52.498942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a55b29c3502461cb780f9a3ce844b88, group_id=aae1d079803741ba8eb483f854a2dc83, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:52.500607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:52.534316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 192/389] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 05:14:52 2022] PUT /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88/groups/aae1d079803741ba8eb483f854a2dc83/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:52.555331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:52.619694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:52.698868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3b8d3-7ce5-438b-bb85-3e68b890ffec None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:52.741536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:52.742185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:52.742465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:52.742740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:52.758120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:52.763435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:52.764356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:52.765164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:52.765790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 198/390] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:52.770417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:52.912717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361c6d2-87c2-48bc-96b2-c813044767f6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:52.960338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:52.960930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:52.961211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:52.961480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:52.962147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:52.962443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:52.963809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:52.975658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 193/391] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:52.981071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:53.117647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311c62-1e8a-488d-9da8-a3f03c108933 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:53.125237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:53.160968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:53.161987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.162494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.162969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.165460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:53.167197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:53.169449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 199/392] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:52 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:53.174684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:53.193656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:53.301028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad57b0-4c8a-4ff2-854c-19abb57daea0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:53.336219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08234fee-b4fa-42f5-9b81-95a05754dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:53.336996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08234fee-b4fa-42f5-9b81-95a05754dedf None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.337276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08234fee-b4fa-42f5-9b81-95a05754dedf None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.337549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08234fee-b4fa-42f5-9b81-95a05754dedf None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.340579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08234fee-b4fa-42f5-9b81-95a05754dedf None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:53.342128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08234fee-b4fa-42f5-9b81-95a05754dedf None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:53.344348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 194/393] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:53 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:53.350077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:53.411844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd40-9c3d-4daa-af0f-eb8adfcfcc0e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.412414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd40-9c3d-4daa-af0f-eb8adfcfcc0e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.412898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd40-9c3d-4daa-af0f-eb8adfcfcc0e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.414808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 195/394] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:53.420187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570847a-4547-4731-8944-c991e0536be1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.420744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570847a-4547-4731-8944-c991e0536be1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.421215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570847a-4547-4731-8944-c991e0536be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.451820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c570847a-4547-4731-8944-c991e0536be1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:53.453070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c570847a-4547-4731-8944-c991e0536be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:53.512663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1658cf-c649-4a8b-801f-d5cdbed8b795 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:53.554462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 196/395] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:53.556312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37936ef2-6f09-4126-946c-220e2b9555a0 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.556609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37936ef2-6f09-4126-946c-220e2b9555a0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.556885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37936ef2-6f09-4126-946c-220e2b9555a0 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.558373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 197/396] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:53.565026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0bcfe-53be-46bb-abcd-e5d69d10a908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:53.565714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bcfe-53be-46bb-abcd-e5d69d10a908 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.565999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bcfe-53be-46bb-abcd-e5d69d10a908 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.566303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0bcfe-53be-46bb-abcd-e5d69d10a908 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88/groups/aae1d079803741ba8eb483f854a2dc83/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.569611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54bb4-278b-43e2-ba97-2df36d91c9d9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.569899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54bb4-278b-43e2-ba97-2df36d91c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.570175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54bb4-278b-43e2-ba97-2df36d91c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.573495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0bcfe-53be-46bb-abcd-e5d69d10a908 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a55b29c3502461cb780f9a3ce844b88, group_id=aae1d079803741ba8eb483f854a2dc83, role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:53.575018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0bcfe-53be-46bb-abcd-e5d69d10a908 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:53.583366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:53.601272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c5a54bb4-278b-43e2-ba97-2df36d91c9d9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:53.602597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c5a54bb4-278b-43e2-ba97-2df36d91c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:53.608593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 200/397] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 05:14:53 2022] PUT /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88/groups/aae1d079803741ba8eb483f854a2dc83/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:53.686786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:53.778196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6935964-ec05-423a-a0f6-874add4c37e6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.778866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6935964-ec05-423a-a0f6-874add4c37e6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.779361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6935964-ec05-423a-a0f6-874add4c37e6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.781424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 201/399] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:53.787500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3165d31-e6c7-4db9-a2ed-6f6ad0aeeada None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:53.787807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3165d31-e6c7-4db9-a2ed-6f6ad0aeeada None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:53.788052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3165d31-e6c7-4db9-a2ed-6f6ad0aeeada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:53.813830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e3165d31-e6c7-4db9-a2ed-6f6ad0aeeada None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:53.814977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e3165d31-e6c7-4db9-a2ed-6f6ad0aeeada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:53.905161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 199/400] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:53.927739 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6935964-ec05-423a-a0f6-874add4c37e6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:53.982673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:54.085914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6935964-ec05-423a-a0f6-874add4c37e6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.129911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.130643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.130836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.131117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.144255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:54.149232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:54.150074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:54.151615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 202/401] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:54.152560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3165d31-e6c7-4db9-a2ed-6f6ad0aeeada None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.161818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.243396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:54.287623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:54.292530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3165d31-e6c7-4db9-a2ed-6f6ad0aeeada None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.296906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d648-a0ca-4708-842c-b9e2e9ad18b8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.334379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.335250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.335691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.336335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.337136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:54.337573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.337753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:54.338435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.338809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.339224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.339736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:54.353022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 203/402] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:54.353213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:54.354212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:54.357378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:54.358463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:54.359463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:54.367304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 200/403] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:14:54.367304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.466585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f41d5-2423-4772-a99a-a5f5212d5864 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.483477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ea0cd-9d37-4e20-8e3b-593d4c547204 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.503725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.505043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.505328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.505603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.516336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:54.522544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:54.528031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:54.529058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:54.529838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:54.534098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 204/404] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:54.535229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.537659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.538831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.540377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.540896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.542320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:54.544542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:54.547016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 201/405] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:54.553962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.557202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:54.667147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b6abb-973d-481a-b7da-2ea03d1e1cdc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.674411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebd5aa-3b3e-4de6-bbd7-1a988c2d97cc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.713053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.713258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.713891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.714176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.714452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.714784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.715126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:54.715433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:54.715729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.716201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.716867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:54.717278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:54.717783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:54.719345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:54.728890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 205/407] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:54.729972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.731493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 202/407] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:54.732816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.791143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:54.813137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:54.838926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db97677-ef0d-40a9-b5e8-556e5a37c0a5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.840699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed441c9-3104-488f-9874-e139139ec98d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:54.877893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.878528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.878781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:54.878897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.879102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] PATH_INFO: `/v3/groups/69b0332a90184d2ca1ca33d6d7f0faf8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.879919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:54.880219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] RBAC: Authorizing `identity:get_group(group_id=69b0332a90184d2ca1ca33d6d7f0faf8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:54.880628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:54.881090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:54.881840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:54.882614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:54.884228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:54.890869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 203/409] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/groups/69b0332a90184d2ca1ca33d6d7f0faf8 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:54.890869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.891193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 206/409] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:54.892160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:54.996718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7f6ea-63d9-497d-9e4a-bae5f5307a08 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:55.001330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f4ee7-999e-4292-8a4f-d47b63e2a0fd None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:55.024528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:55.033469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:55.034446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.035629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.036131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] PATH_INFO: `/v3/projects/f856f4ace59d412c839fff1b080f7b3c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.037698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] RBAC: Authorizing `identity:get_project(project_id=f856f4ace59d412c839fff1b080f7b3c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:55.038687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:55.039338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.039655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.039935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.040306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:55.041173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:55.042690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:55.042911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 207/410] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/projects/f856f4ace59d412c839fff1b080f7b3c => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:55.043853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:55.048530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 204/411] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:54 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:55.049483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:55.064463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:55.165749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e294d-95c9-4753-b1b7-87e3980f493e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:55.179424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a6ed4-503d-489b-a3ed-af4b3a246c25 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:55.210554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:55.211680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.212170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.212982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/groups/aae1d079803741ba8eb483f854a2dc83/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.215381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] RBAC: Authorizing `identity:create_grant(project_id=0866ec7b5e9f4d4c947e6a65533662f7, group_id=aae1d079803741ba8eb483f854a2dc83, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:55.217516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:55.230196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688366-5417-4fe2-bfdc-7fec59808f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:55.231307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688366-5417-4fe2-bfdc-7fec59808f7a None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.231813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688366-5417-4fe2-bfdc-7fec59808f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.232374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688366-5417-4fe2-bfdc-7fec59808f7a None admin] PATH_INFO: `/v3/projects/f856f4ace59d412c839fff1b080f7b3c/groups/69b0332a90184d2ca1ca33d6d7f0faf8/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.235363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688366-5417-4fe2-bfdc-7fec59808f7a None admin] RBAC: Authorizing `identity:create_grant(project_id=f856f4ace59d412c839fff1b080f7b3c, group_id=69b0332a90184d2ca1ca33d6d7f0faf8, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:55.237371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 208/412] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 05:14:55 2022] PUT /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/groups/aae1d079803741ba8eb483f854a2dc83/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:55.248827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688366-5417-4fe2-bfdc-7fec59808f7a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:55.249322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:55.276785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 205/413] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 05:14:55 2022] PUT /identity/v3/projects/f856f4ace59d412c839fff1b080f7b3c/groups/69b0332a90184d2ca1ca33d6d7f0faf8/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:55.276785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88691-df10-48fc-9b14-4bd2ca0854a6 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.276785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88691-df10-48fc-9b14-4bd2ca0854a6 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.276785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88691-df10-48fc-9b14-4bd2ca0854a6 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.276785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 206/414] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:55.284544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e39d1-0940-492b-b2f8-922564db57d8 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.284926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e39d1-0940-492b-b2f8-922564db57d8 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.285655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e39d1-0940-492b-b2f8-922564db57d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.321004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-982e39d1-0940-492b-b2f8-922564db57d8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:55.326961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-982e39d1-0940-492b-b2f8-922564db57d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:55.387639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:55.422700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:55.449560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46666e7-2e7c-4810-9f3f-8468b9029aed None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:55.454799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 207/415] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:55.494282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:55.494943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.495226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.495504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.496708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:55.498436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:55.500527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 209/416] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:55 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:55.506964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e39d1-0940-492b-b2f8-922564db57d8 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:55.622678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e39d1-0940-492b-b2f8-922564db57d8 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:55.670453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:55.671443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.671866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.672304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/groups/aae1d079803741ba8eb483f854a2dc83/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.675527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] RBAC: Authorizing `identity:create_grant(project_id=0866ec7b5e9f4d4c947e6a65533662f7, group_id=aae1d079803741ba8eb483f854a2dc83, role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:55.677972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:55.703244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 208/417] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 21 05:14:55 2022] PUT /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7/groups/aae1d079803741ba8eb483f854a2dc83/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:14:55.755703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:55.894480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea21b-f0ad-4e3c-9813-4428c8f53eda None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:55.933206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a79a-7854-4ee9-99b8-bc06937bc337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:55.934205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a79a-7854-4ee9-99b8-bc06937bc337 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:55.934684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a79a-7854-4ee9-99b8-bc06937bc337 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:55.935181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a79a-7854-4ee9-99b8-bc06937bc337 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:55.945389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:55.949568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1a79a-7854-4ee9-99b8-bc06937bc337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-95b1a79a-7854-4ee9-99b8-bc06937bc337 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:55.955041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:55.956026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:14:55.957010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 210/418] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:55.963778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:56.018605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:56.082578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53e99-4144-4241-b7d6-5a3a1982cf6e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:56.087264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864cd89-f220-4e6d-b558-5218ea0ae346 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:56.087546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864cd89-f220-4e6d-b558-5218ea0ae346 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:56.087822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864cd89-f220-4e6d-b558-5218ea0ae346 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:56.090494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 211/419] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:56.094904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed54d8-1505-47db-8351-71e2da09f62a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:56.095180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed54d8-1505-47db-8351-71e2da09f62a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:56.095452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed54d8-1505-47db-8351-71e2da09f62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:56.118841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:56.119451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:56.119731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:56.120022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:56.120708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:56.121017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:56.121467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-61ed54d8-1505-47db-8351-71e2da09f62a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:56.122657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:56.122925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-61ed54d8-1505-47db-8351-71e2da09f62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:56.132419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 209/420] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:56.143570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:56.202818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 212/421] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:56.261636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ab910-5186-485d-a042-ec4b503b5b35 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:56.263174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:56.295888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:56.296442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:56.296721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:56.296989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:56.367605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:56.369094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:56.469331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 210/422] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:56.475563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed54d8-1505-47db-8351-71e2da09f62a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:56.609608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:56.612041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:56.617982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed54d8-1505-47db-8351-71e2da09f62a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:56.681603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:56.695017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:56.696102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:56.697490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:56.700535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:56.701944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:56.703592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:56.705577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 213/423] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:56 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:56.711029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:56.789154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41431b7d-adb9-4cd3-9414-1882622b0bb2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:56.868666 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:56.869243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:56.869524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:56.869798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:56.888349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:56.893426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:56.894337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:56.895122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 211/424] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:14:56.905112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5566d9-d21d-449a-9be0-5302f3e5e137 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:56.907524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:56.968258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:56.968913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:56.969194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:56.969467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:56.971147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:56.975229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:56.977870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 214/425] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:56 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:56.983949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:57.030812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:57.096911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:57.132559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3481d2-afd9-4599-8fea-966ab78cc5e9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:57.136603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ed11-25ab-4c37-9ee5-3880af5e7c91 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:57.181811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:57.182413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:57.182694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:57.182970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:57.183691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=3a55b29c3502461cb780f9a3ce844b88) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:57.184001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:57.185487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:57.192488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 215/426] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:56 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=75d345ed873a4df3be5afc217fb2676f => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:57.202555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:57.203189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:57.203468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:57.203740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:57.204500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:57.204805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:57.206230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:57.227573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 212/427] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:57.233353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:57.376922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8620da5-be31-4dcf-8ff6-fe308efbc8fb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:57.417584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:57.424000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794bf4e-ac18-4a5d-9160-b31de581dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:57.424641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794bf4e-ac18-4a5d-9160-b31de581dedc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:57.424917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794bf4e-ac18-4a5d-9160-b31de581dedc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:57.425189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794bf4e-ac18-4a5d-9160-b31de581dedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:57.499283 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794bf4e-ac18-4a5d-9160-b31de581dedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:57.500792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794bf4e-ac18-4a5d-9160-b31de581dedc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:57.612312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 216/428] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:57.621605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:57.752001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c1284-00b2-4258-89b1-e316ace6cb8a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:57.783423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:57.787830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f08aa2-ffce-47e4-8827-82512ef90084 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:57.788117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f08aa2-ffce-47e4-8827-82512ef90084 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:57.792473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f08aa2-ffce-47e4-8827-82512ef90084 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:57.793870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 217/429] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:57.798826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:57.799471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:57.799750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:57.800025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] PATH_INFO: `/v3/projects/3a55b29c3502461cb780f9a3ce844b88` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:57.801308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7fc97-9256-46d5-9b66-5050054b8265 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:57.801812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7fc97-9256-46d5-9b66-5050054b8265 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:57.801914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] RBAC: Authorizing `identity:get_project(project_id=3a55b29c3502461cb780f9a3ce844b88)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:57.802380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7fc97-9256-46d5-9b66-5050054b8265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:57.803253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:57.805219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 213/430] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:57 2022] GET /identity/v3/projects/3a55b29c3502461cb780f9a3ce844b88 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:57.811472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:57.826803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-71a7fc97-9256-46d5-9b66-5050054b8265 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:57.828416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-71a7fc97-9256-46d5-9b66-5050054b8265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:57.876645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:57.908351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 218/431] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:57.925398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d1fc-17bd-4c9f-9b2a-a7d857bda335 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:57.959740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2028f85-aafe-4096-912e-bae024185de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:57.960415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2028f85-aafe-4096-912e-bae024185de2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:57.960706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2028f85-aafe-4096-912e-bae024185de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:57.960981 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2028f85-aafe-4096-912e-bae024185de2 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:57.962108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2028f85-aafe-4096-912e-bae024185de2 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:57.963563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2028f85-aafe-4096-912e-bae024185de2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:57.965452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 214/432] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:57 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:57.971489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7fc97-9256-46d5-9b66-5050054b8265 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:58.074396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7fc97-9256-46d5-9b66-5050054b8265 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:58.114117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef3083-7d07-4161-9ca6-2cfbf7efe0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:58.115055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef3083-7d07-4161-9ca6-2cfbf7efe0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.115511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef3083-7d07-4161-9ca6-2cfbf7efe0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.115958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef3083-7d07-4161-9ca6-2cfbf7efe0b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.116900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef3083-7d07-4161-9ca6-2cfbf7efe0b8 None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=3a55b29c3502461cb780f9a3ce844b88) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:58.117409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef3083-7d07-4161-9ca6-2cfbf7efe0b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:58.119041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef3083-7d07-4161-9ca6-2cfbf7efe0b8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:58.126352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 219/433] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:57 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=3a55b29c3502461cb780f9a3ce844b88&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:58.215307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fee75-eae9-4dc1-97cd-f5c744588839 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.215831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fee75-eae9-4dc1-97cd-f5c744588839 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.216109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fee75-eae9-4dc1-97cd-f5c744588839 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.217615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 215/434] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:14:58.224608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5361ec-606e-4229-947b-9b27e80e8c37 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.224906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5361ec-606e-4229-947b-9b27e80e8c37 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.225158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5361ec-606e-4229-947b-9b27e80e8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.245111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ff5361ec-606e-4229-947b-9b27e80e8c37 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:58.246196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fee75-eae9-4dc1-97cd-f5c744588839 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:58.246304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ff5361ec-606e-4229-947b-9b27e80e8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:58.284657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:58.340501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:58.358003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 220/435] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:14:58.399555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fee75-eae9-4dc1-97cd-f5c744588839 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:58.438042 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16addd-630f-44e1-80ae-9bb755bf5bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:58.439026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16addd-630f-44e1-80ae-9bb755bf5bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.439542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16addd-630f-44e1-80ae-9bb755bf5bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.440020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16addd-630f-44e1-80ae-9bb755bf5bf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.451518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16addd-630f-44e1-80ae-9bb755bf5bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-ae16addd-630f-44e1-80ae-9bb755bf5bf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:58.457708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:58.458627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 05:14:58.459544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:58.460470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 216/436] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:58.466375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5361ec-606e-4229-947b-9b27e80e8c37 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:58.515256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbff1d-9464-412f-99f7-d4df9fc86019 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.515555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbff1d-9464-412f-99f7-d4df9fc86019 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.515818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbff1d-9464-412f-99f7-d4df9fc86019 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.518467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 217/437] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:14:58.523115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da000f-d615-4043-8ec2-ee29c58fec2e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.523397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da000f-d615-4043-8ec2-ee29c58fec2e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.523679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da000f-d615-4043-8ec2-ee29c58fec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.542675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c8da000f-d615-4043-8ec2-ee29c58fec2e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:14:58.543904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c8da000f-d615-4043-8ec2-ee29c58fec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:14:58.583686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5361ec-606e-4229-947b-9b27e80e8c37 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:58.625785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:58.626739 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.627210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.627672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.628425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 218/438] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:14:58.629396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] RBAC: Adding query filter params (name=member) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:58.629396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:58.630783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:58.635520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da000f-d615-4043-8ec2-ee29c58fec2e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:58.640710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 221/439] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:14:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:58.640710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:58.666810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:58.703389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:58.760422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97268602-3971-4f4c-a40b-8d9cf9409525 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:58.763748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da000f-d615-4043-8ec2-ee29c58fec2e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:58.794930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:58.795536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.795934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.796084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.802854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5299-347d-4870-a192-959124397930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:58.803479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5299-347d-4870-a192-959124397930 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.803756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5299-347d-4870-a192-959124397930 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.804028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5299-347d-4870-a192-959124397930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.814479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb5299-347d-4870-a192-959124397930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-57bb5299-347d-4870-a192-959124397930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:58.819736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:58.820657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:58.821434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 219/440] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:58.826566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5299-347d-4870-a192-959124397930 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:58.876773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:58.878161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:58.897522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:58.932236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5299-347d-4870-a192-959124397930 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:58.942798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:58.965743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:58.966338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:58.966617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:58.966888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:58.967550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:58.967850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:58.969264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:58.977323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 220/441] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:14:58.977686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 222/442] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 05:14:58.978737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:58.983125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.081846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc3b8-0919-457c-907e-d4b5a05c051a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.087357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8e7b-3a2f-4b81-a9ba-8de18d3ae7fc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.103053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.116156 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.116808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.117082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.117359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.121193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.121793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.122071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.122602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.127353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:14:59.133082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:14:59.134128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 221/443] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:14:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:14:59.135101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.167486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.192568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.194026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.234239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134f14d-26d9-4f54-83b5-2382ccb029e2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.266683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.267301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.267580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.267856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.268991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.270459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.272120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 222/444] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:59.272907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.292851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 223/445] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 05:14:59.293675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.313560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.372898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.376229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba8d1-57f9-44c6-972d-abfd40f373c4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.396825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c7512-81ac-4a8f-a6e9-35921c6b323b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.408578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.409185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.409465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.409738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.410894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:59.411197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.412590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.420353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 223/446] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:59.421135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.430267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.430895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.431173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.431444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.432557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.434002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.435541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 224/447] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:59.436310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.515571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.526463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc308-9882-4cad-a816-e3292c9c4f0f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.531361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c93e82-072c-450b-b64f-cd59db0c6df6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.559701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.560351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.560632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.560912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] PATH_INFO: `/v3/projects/f856f4ace59d412c839fff1b080f7b3c` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.562024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] RBAC: Authorizing `identity:get_project(project_id=f856f4ace59d412c839fff1b080f7b3c)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.563467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.565330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 224/448] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/projects/f856f4ace59d412c839fff1b080f7b3c => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:59.565433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.565805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.565897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.566160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.566340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.600051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.633763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.635199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.668492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308dba-75ec-4117-9bb3-f9b9ae7ca774 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.701820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.702431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.702712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.702987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.703726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=75d345ed873a4df3be5afc217fb2676f, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:14:59.704033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.705532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.711869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 225/449] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=75d345ed873a4df3be5afc217fb2676f => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:59.712793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.715960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.736808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 225/450] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:14:59.743172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.833181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:14:59.840919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28667-4e57-45a1-8560-5170d6e6eb08 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.862789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368848b-82a0-444e-99d9-e03b3c23625d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:14:59.883636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.884878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.884878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.884878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] PATH_INFO: `/v3/groups/69b0332a90184d2ca1ca33d6d7f0faf8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.887165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] RBAC: Authorizing `identity:get_group(group_id=69b0332a90184d2ca1ca33d6d7f0faf8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.888829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.890140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 226/451] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/groups/69b0332a90184d2ca1ca33d6d7f0faf8 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:59.895505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.905798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:14:59.906580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:14:59.906688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:14:59.906961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] PATH_INFO: `/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:14:59.908082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] RBAC: Authorizing `identity:get_project(project_id=0866ec7b5e9f4d4c947e6a65533662f7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:14:59.909607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:14:59.912098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 226/452] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/projects/0866ec7b5e9f4d4c947e6a65533662f7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:14:59.917507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:14:59.980186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:00.018770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4c53-da69-473d-9242-bf6f0da280be None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:00.034151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0354-0024-4b81-b8bf-d43c25a525f8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:00.056461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:00.057077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:00.057356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:00.057627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:00.058346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] RBAC: Adding query filter params (group.id=69b0332a90184d2ca1ca33d6d7f0faf8, role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=f856f4ace59d412c839fff1b080f7b3c) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:00.058655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:00.060087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:00.068105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 227/453] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/role_assignments?group.id=69b0332a90184d2ca1ca33d6d7f0faf8&scope.project.id=f856f4ace59d412c839fff1b080f7b3c&role.id=7407c800e8af41e2bc429a186be077ba => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:00.072395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961156d-611d-4df2-85c8-d7d6144f0923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:00.073057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961156d-611d-4df2-85c8-d7d6144f0923 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:00.074107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961156d-611d-4df2-85c8-d7d6144f0923 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:00.074107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961156d-611d-4df2-85c8-d7d6144f0923 None admin] PATH_INFO: `/v3/groups/aae1d079803741ba8eb483f854a2dc83` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:00.075010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961156d-611d-4df2-85c8-d7d6144f0923 None admin] RBAC: Authorizing `identity:get_group(group_id=aae1d079803741ba8eb483f854a2dc83)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:00.076517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961156d-611d-4df2-85c8-d7d6144f0923 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:00.083653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 227/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 21 05:14:59 2022] GET /identity/v3/groups/aae1d079803741ba8eb483f854a2dc83 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:00.084759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:00.116851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:00.192335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743a5d0-5f06-4c85-8990-6f6a73236662 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:00.227224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8138b5-a9ad-4534-8597-b85d1558fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:00.227839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8138b5-a9ad-4534-8597-b85d1558fedf None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:00.228118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8138b5-a9ad-4534-8597-b85d1558fedf None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:00.228417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8138b5-a9ad-4534-8597-b85d1558fedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:00.229150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8138b5-a9ad-4534-8597-b85d1558fedf None admin] RBAC: Adding query filter params (group.id=aae1d079803741ba8eb483f854a2dc83, role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:00.229461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8138b5-a9ad-4534-8597-b85d1558fedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:00.230978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8138b5-a9ad-4534-8597-b85d1558fedf None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:00.236901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 228/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 21 05:15:00 2022] GET /identity/v3/role_assignments?group.id=aae1d079803741ba8eb483f854a2dc83&scope.project.id=0866ec7b5e9f4d4c947e6a65533662f7&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:02.905941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f85d9-e118-41c3-b743-d05b7ad0a1c8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:02.906886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f85d9-e118-41c3-b743-d05b7ad0a1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:02.907399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f85d9-e118-41c3-b743-d05b7ad0a1c8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:02.909211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 228/456] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:02.914778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf0c47-b929-49b6-bde1-e36f5394aa1e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:02.915579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf0c47-b929-49b6-bde1-e36f5394aa1e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:02.916048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf0c47-b929-49b6-bde1-e36f5394aa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:02.942438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-cddf0c47-b929-49b6-bde1-e36f5394aa1e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:02.944032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cddf0c47-b929-49b6-bde1-e36f5394aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:03.037523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 229/457] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:03.050738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585bf6-fa7a-4668-9be0-4b77be6162ee None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.051286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585bf6-fa7a-4668-9be0-4b77be6162ee None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.051799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585bf6-fa7a-4668-9be0-4b77be6162ee None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.053356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 229/458] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:03.058575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c915-d938-4a43-b4b6-749547a8cb4e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.058835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c915-d938-4a43-b4b6-749547a8cb4e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.059109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c915-d938-4a43-b4b6-749547a8cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.085265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1611c915-d938-4a43-b4b6-749547a8cb4e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:03.086468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1611c915-d938-4a43-b4b6-749547a8cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:03.105813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:03.176100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 230/459] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:03.379551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa585bf6-fa7a-4668-9be0-4b77be6162ee None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:03.518624 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611c915-d938-4a43-b4b6-749547a8cb4e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:03.521679 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa585bf6-fa7a-4668-9be0-4b77be6162ee None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:03.553363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:03.575922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6bbaa-6533-439a-91e7-006f0fdfda0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:03.576819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6bbaa-6533-439a-91e7-006f0fdfda0d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.577233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6bbaa-6533-439a-91e7-006f0fdfda0d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.577663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6bbaa-6533-439a-91e7-006f0fdfda0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.588358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6bbaa-6533-439a-91e7-006f0fdfda0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:03.589989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6bbaa-6533-439a-91e7-006f0fdfda0d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a2a6bbaa-6533-439a-91e7-006f0fdfda0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:03.604794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:03.605725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:03.606559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:03.606559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:03.606559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:03.608580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 230/460] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:03.609961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0752-2500-43ed-8e54-be4c09dbe800 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.610436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0752-2500-43ed-8e54-be4c09dbe800 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.610890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0752-2500-43ed-8e54-be4c09dbe800 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.612308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 231/461] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:03.614702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e0752-2500-43ed-8e54-be4c09dbe800 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:03.643010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611c915-d938-4a43-b4b6-749547a8cb4e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:03.685733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f44df8-bf1e-4ec2-949c-4d342e31b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:03.686370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f44df8-bf1e-4ec2-949c-4d342e31b47f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.686648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f44df8-bf1e-4ec2-949c-4d342e31b47f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.686920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f44df8-bf1e-4ec2-949c-4d342e31b47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.698724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f44df8-bf1e-4ec2-949c-4d342e31b47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:03.700308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f44df8-bf1e-4ec2-949c-4d342e31b47f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-81f44df8-bf1e-4ec2-949c-4d342e31b47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:03.717173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:03.718144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:03.718994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:03.718994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:03.718994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:03.718994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 231/462] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:03.719980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e38d9-1d10-465c-9987-d06ee249998b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.720269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e38d9-1d10-465c-9987-d06ee249998b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.720566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e38d9-1d10-465c-9987-d06ee249998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.729277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:03.734004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e0752-2500-43ed-8e54-be4c09dbe800 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:03.744721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-284e38d9-1d10-465c-9987-d06ee249998b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:03.745634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-284e38d9-1d10-465c-9987-d06ee249998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:03.775470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:03.776608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.777079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.777647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.778616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:03.779105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:03.780934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:03.795096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 232/463] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:03.796395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:03.824485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 232/464] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:03.825250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e38d9-1d10-465c-9987-d06ee249998b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:03.831870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:03.921657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee015f-91fe-4994-9da9-4b7288fa2c3d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:03.944572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e38d9-1d10-465c-9987-d06ee249998b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:03.968046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbad46-9139-40ba-a0f3-eb917af3e746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:03.968835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbad46-9139-40ba-a0f3-eb917af3e746 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.969281 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbad46-9139-40ba-a0f3-eb917af3e746 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.969719 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbad46-9139-40ba-a0f3-eb917af3e746 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.970701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbad46-9139-40ba-a0f3-eb917af3e746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:03.971149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbad46-9139-40ba-a0f3-eb917af3e746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:03.973690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbad46-9139-40ba-a0f3-eb917af3e746 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:03.981384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:03.986765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9128c8-414c-4b32-af3e-50b17724ae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:03.987380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 233/465] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:03.987945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9128c8-414c-4b32-af3e-50b17724ae55 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.989030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9128c8-414c-4b32-af3e-50b17724ae55 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.989534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9128c8-414c-4b32-af3e-50b17724ae55 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.989988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6348c-3a33-4515-b537-dd9315f98bf2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:03.990285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6348c-3a33-4515-b537-dd9315f98bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:03.990556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6348c-3a33-4515-b537-dd9315f98bf2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:03.991062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9128c8-414c-4b32-af3e-50b17724ae55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:03.992183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 234/466] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:03.992916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6348c-3a33-4515-b537-dd9315f98bf2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:03.993571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9128c8-414c-4b32-af3e-50b17724ae55 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:04.024030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 233/467] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:15:03 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:04.026651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59e60-4338-4bf4-b4ee-1ea1b4e64fc8 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.027259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59e60-4338-4bf4-b4ee-1ea1b4e64fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.027779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59e60-4338-4bf4-b4ee-1ea1b4e64fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.054739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-eeb59e60-4338-4bf4-b4ee-1ea1b4e64fc8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:04.057034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eeb59e60-4338-4bf4-b4ee-1ea1b4e64fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:04.106400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:04.120957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6348c-3a33-4515-b537-dd9315f98bf2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:04.149482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 234/468] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:04.151364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59e60-4338-4bf4-b4ee-1ea1b4e64fc8 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:04.165750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:04.166396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.166718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.167052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.167735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:04.169285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:04.200236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 235/469] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:15:03 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:04.287572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59e60-4338-4bf4-b4ee-1ea1b4e64fc8 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:04.310295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:04.332345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:04.333366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.333861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.334326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.346763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:04.349266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:04.366153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:04.367101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:04.367979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:04.367979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:04.367979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:04.369936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 235/470] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:04.378509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:04.494832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb6912-c417-4fad-8a42-bb9369b99cfb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:04.517222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:04.534256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:04.534927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.535211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.535484 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.536140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:04.536482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:04.537964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:04.554016 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 236/471] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:04.560826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:04.579399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:04.671475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53a84c-8614-4649-b9a6-59ea11e790c2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:04.731722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dfe68-15b3-4cea-a2e1-365282cd9644 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:04.738341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deec444-f999-4dcf-98d7-ed4fd889e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:04.739277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deec444-f999-4dcf-98d7-ed4fd889e2bc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.739753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deec444-f999-4dcf-98d7-ed4fd889e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.740215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deec444-f999-4dcf-98d7-ed4fd889e2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.755879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deec444-f999-4dcf-98d7-ed4fd889e2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:04.758220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deec444-f999-4dcf-98d7-ed4fd889e2bc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:04.773330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:04.774034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.774448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.774810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.775523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:04.777091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-6deec444-f999-4dcf-98d7-ed4fd889e2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:04.777346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:04.778218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:04.779093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:04.779093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:04.779093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:04.781193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 236/472] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:04.782591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de433d2-aecb-4364-a3da-d3616bfa1c65 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.783083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de433d2-aecb-4364-a3da-d3616bfa1c65 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.783545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de433d2-aecb-4364-a3da-d3616bfa1c65 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.789397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 237/473] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:04.790903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3618-7101-4858-a4b1-873e0b5fb6fa None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:04.791714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3618-7101-4858-a4b1-873e0b5fb6fa None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:04.792210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3618-7101-4858-a4b1-873e0b5fb6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:04.808914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 237/474] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:15:04 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:04.810275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:04.818868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0a4b3618-7101-4858-a4b1-873e0b5fb6fa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:04.820407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0a4b3618-7101-4858-a4b1-873e0b5fb6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:04.846617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:04.895124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:04.907028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 238/475] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:04.964474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6e02-4516-41e7-abc5-f7a566a3cd5c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:05.021901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:05.022526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:05.022810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:05.023083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:05.023733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:05.024040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:05.025475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:05.039626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 238/476] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:05.044985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3618-7101-4858-a4b1-873e0b5fb6fa None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:05.151010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3618-7101-4858-a4b1-873e0b5fb6fa None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:05.187400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:05.188011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:05.188318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:05.188607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:05.189267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:05.190834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:05.227982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 239/477] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:15:05 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:15:05.245726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:05.375175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb67bb-da8c-41d2-b352-d5030f0a6cb8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:05.408126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:05.422045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:05.422710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:05.422990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:05.423266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:05.423957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:05.425997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:05.435565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.sql.core [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 05:15:05.435565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 05:15:05.435565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [parameters: {'id': '69cd3025c1be4da0907fafb3256c1573', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 05:15:05.435565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 21 05:15:05.452722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return ref.to_dict() Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 05:15:05.453610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application yield resource Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise self.value Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application session.commit() Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 05:15:05.455130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.flush() Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application compat.raise_( Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 05:15:05.456014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 05:15:05.457255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 05:15:05.458409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [parameters: {'id': '69cd3025c1be4da0907fafb3256c1573', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:05.459253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 05:15:05.460056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:05.461104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 239/478] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 05:15:05 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:05.462307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:05.476928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:05.577323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993896-d700-4b85-917d-ac96e8d8d3fe None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:05.614498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9475f-c564-41eb-a185-a25a861128ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:05.615133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9475f-c564-41eb-a185-a25a861128ce None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:05.615468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9475f-c564-41eb-a185-a25a861128ce None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:05.615834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9475f-c564-41eb-a185-a25a861128ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:05.627503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9475f-c564-41eb-a185-a25a861128ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-91e9475f-c564-41eb-a185-a25a861128ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:05.632813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:05.633874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:05.634833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 240/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:05.641343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:05.757314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1836f-992b-402d-8499-56004cf7b804 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:05.799895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab595e9-b327-4d45-b60e-49fe11fcf070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:05.800676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab595e9-b327-4d45-b60e-49fe11fcf070 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:05.801033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab595e9-b327-4d45-b60e-49fe11fcf070 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:05.801417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab595e9-b327-4d45-b60e-49fe11fcf070 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:05.802171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab595e9-b327-4d45-b60e-49fe11fcf070 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:05.802549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab595e9-b327-4d45-b60e-49fe11fcf070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:05.804006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab595e9-b327-4d45-b60e-49fe11fcf070 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:05.813317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 240/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:06.817019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e5b8-e521-4e13-bc46-a5854acd5349 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:06.817550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e5b8-e521-4e13-bc46-a5854acd5349 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:06.817728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e5b8-e521-4e13-bc46-a5854acd5349 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:06.819398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 241/481] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:06.825166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2833b4-3523-4d0b-9a83-42e2b7866857 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:06.825579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2833b4-3523-4d0b-9a83-42e2b7866857 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:06.825722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2833b4-3523-4d0b-9a83-42e2b7866857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:06.849341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fc2833b4-3523-4d0b-9a83-42e2b7866857 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:06.850557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fc2833b4-3523-4d0b-9a83-42e2b7866857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:06.920872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:06.955085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 241/482] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:07.051077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47319fc4-7a6d-403c-95a8-a137a5ffc8bc None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.051360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47319fc4-7a6d-403c-95a8-a137a5ffc8bc None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.051663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47319fc4-7a6d-403c-95a8-a137a5ffc8bc None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.053321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 242/483] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:07.058372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3d19-fcce-45f9-834a-c39fc9639b0d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.058662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3d19-fcce-45f9-834a-c39fc9639b0d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.058939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3d19-fcce-45f9-834a-c39fc9639b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.088599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ea1e3d19-fcce-45f9-834a-c39fc9639b0d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:07.089803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ea1e3d19-fcce-45f9-834a-c39fc9639b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:07.188508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 242/484] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:07.355500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47319fc4-7a6d-403c-95a8-a137a5ffc8bc None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:07.453652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:07.503110 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47319fc4-7a6d-403c-95a8-a137a5ffc8bc None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:07.513936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3d19-fcce-45f9-834a-c39fc9639b0d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:07.553510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:07.554167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.554467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.554751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.589003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:07.594230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:07.595127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:07.595951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:07.599050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 243/485] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:07.604508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:07.686810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3d19-fcce-45f9-834a-c39fc9639b0d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:07.707668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:07.755077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:07.755720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.756222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.756525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.772519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:07.773836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691729e5-65b2-474b-a6a6-a9111a12b490 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:07.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:07.778246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:07.779053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 243/486] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:07.785728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:07.825352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:07.846500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd634a8-5575-4624-bff7-776cb333386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:07.847202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd634a8-5575-4624-bff7-776cb333386c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.847970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd634a8-5575-4624-bff7-776cb333386c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.848249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd634a8-5575-4624-bff7-776cb333386c None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.848949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd634a8-5575-4624-bff7-776cb333386c None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:07.849250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd634a8-5575-4624-bff7-776cb333386c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:07.850912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd634a8-5575-4624-bff7-776cb333386c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:07.864309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 244/487] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:07.864309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5435b-af5e-45d0-b14a-ae0197ae3389 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.864309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5435b-af5e-45d0-b14a-ae0197ae3389 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.864309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5435b-af5e-45d0-b14a-ae0197ae3389 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.864309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 245/488] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:07.869841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2db0e-d97e-44fc-b52f-b22e46f56712 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.870124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2db0e-d97e-44fc-b52f-b22e46f56712 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.870532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2db0e-d97e-44fc-b52f-b22e46f56712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.891905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-21f2db0e-d97e-44fc-b52f-b22e46f56712 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:07.893488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-21f2db0e-d97e-44fc-b52f-b22e46f56712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:07.943160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b5964-5b8d-4b64-b5d3-f2a7ef7e36a4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:07.978013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 246/489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:07.978996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2db0e-d97e-44fc-b52f-b22e46f56712 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:07.986561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:07.987289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:07.987572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:07.987915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:07.988615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:07.989020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:07.990526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.008547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 244/490] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:08.013854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.071557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.089707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2db0e-d97e-44fc-b52f-b22e46f56712 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.127059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.127708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.127988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.128262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.140490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.142034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.142761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:08.160164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:08.161152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:08.161997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:08.161997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:08.161997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:08.161997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 247/491] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:08.168309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.246727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d13b9-04bc-43a4-a5d8-e71b6394ee9b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.308064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797147c-1ff0-4dc1-b28a-8b3b4c09baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.308773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797147c-1ff0-4dc1-b28a-8b3b4c09baa9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.309055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797147c-1ff0-4dc1-b28a-8b3b4c09baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.309332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797147c-1ff0-4dc1-b28a-8b3b4c09baa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.324269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797147c-1ff0-4dc1-b28a-8b3b4c09baa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.326715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797147c-1ff0-4dc1-b28a-8b3b4c09baa9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.332947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57957d74-2f87-45c5-a67e-588bd481a0c4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0797147c-1ff0-4dc1-b28a-8b3b4c09baa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:08.342636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:08.343537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:08.344875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:08.344875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:08.344875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:08.344875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 245/492] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:08.348536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e161104-069a-4403-9d31-24ab2701de13 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.348536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e161104-069a-4403-9d31-24ab2701de13 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.348536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e161104-069a-4403-9d31-24ab2701de13 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.352406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 246/493] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:08.353150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e161104-069a-4403-9d31-24ab2701de13 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.370806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.371419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.371702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.371976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.372957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:08.373264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.374659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.391696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 248/494] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:08.391696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.423137 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.445535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.464301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e161104-069a-4403-9d31-24ab2701de13 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.498487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47476782-b994-47c1-8884-9d833de1a704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.499317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47476782-b994-47c1-8884-9d833de1a704 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.499645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47476782-b994-47c1-8884-9d833de1a704 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.499917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47476782-b994-47c1-8884-9d833de1a704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.506048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5e24b-4709-4163-84b6-6f71800c4581 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.512064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47476782-b994-47c1-8884-9d833de1a704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-47476782-b994-47c1-8884-9d833de1a704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:08.516893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:08.517803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:08.518627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:08.523449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 247/495] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:08.524852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321a32-29ac-4bb3-ad5a-fba4b5912e62 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.525138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321a32-29ac-4bb3-ad5a-fba4b5912e62 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.525413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321a32-29ac-4bb3-ad5a-fba4b5912e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.545987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-20321a32-29ac-4bb3-ad5a-fba4b5912e62 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:08.547224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-20321a32-29ac-4bb3-ad5a-fba4b5912e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:08.547857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.548543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.548827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.549104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.549825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:08.550128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.552129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.570278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 249/496] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:08.570278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.624416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 248/497] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:08.633912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321a32-29ac-4bb3-ad5a-fba4b5912e62 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.665426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.675654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552fbdb-6b4c-4c6d-9097-e1845eebb94f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.710768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.711433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.711721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.712000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.716371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.719576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.721046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:08.733464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:08.734380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:08.735258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 250/498] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:08.736735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.748815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321a32-29ac-4bb3-ad5a-fba4b5912e62 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.784206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15454c09-49fd-4cbb-aba2-f4493199e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.784868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454c09-49fd-4cbb-aba2-f4493199e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.785152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454c09-49fd-4cbb-aba2-f4493199e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.785426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454c09-49fd-4cbb-aba2-f4493199e5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.786092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15454c09-49fd-4cbb-aba2-f4493199e5e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:08.786394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15454c09-49fd-4cbb-aba2-f4493199e5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.787764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15454c09-49fd-4cbb-aba2-f4493199e5e0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.795783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 249/499] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:08.797155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dcad0-43fb-4f67-b473-678577ce9331 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.797446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dcad0-43fb-4f67-b473-678577ce9331 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.797721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dcad0-43fb-4f67-b473-678577ce9331 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.799029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 250/500] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:08.799651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dcad0-43fb-4f67-b473-678577ce9331 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.861189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3666-f922-4208-bdbc-8fc76d5ef67d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.898765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.899397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.899678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.899951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.905497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dcad0-43fb-4f67-b473-678577ce9331 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:08.907326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.908831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:08.920243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:08.921221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 251/501] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:08.922159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:08.937291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.945233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4bb4e-0312-4c82-a5b9-966499c84a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:08.945842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bb4e-0312-4c82-a5b9-966499c84a74 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.946121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bb4e-0312-4c82-a5b9-966499c84a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.946393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4bb4e-0312-4c82-a5b9-966499c84a74 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:08.947115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4bb4e-0312-4c82-a5b9-966499c84a74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:08.947425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4bb4e-0312-4c82-a5b9-966499c84a74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:08.948899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4bb4e-0312-4c82-a5b9-966499c84a74 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:08.959984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:08.984901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 251/502] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:08.986260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43913-5652-433a-a163-28150d3b871c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:08.986549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43913-5652-433a-a163-28150d3b871c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:08.986821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43913-5652-433a-a163-28150d3b871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.004960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-28e43913-5652-433a-a163-28150d3b871c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:09.006078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-28e43913-5652-433a-a163-28150d3b871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:09.022367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76b87-4515-44ff-8ec7-16b11f3b37dc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.056828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.057461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.057748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.058024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.068173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.069659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.070370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 252/503] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:09.073135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43913-5652-433a-a163-28150d3b871c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:09.083812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:09.084824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:09.085688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:09.085688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:09.085688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:09.085688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 252/504] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:09.086426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.162407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.184248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43913-5652-433a-a163-28150d3b871c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.202912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282165f-7bc8-43ab-a4a7-9efd4daacca8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.209776 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.220712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.221357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.221623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.221898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.233397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:09.238678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:09.239707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:09.240742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:09.242786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 253/505] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:09.243001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.243614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.243896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.244125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.244217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.244921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:09.245227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.246844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.287442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 253/506] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:09.288457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.353320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de047b83-e04e-4671-b5ef-da00fed842ef None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.386139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.386742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.387025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.387297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.391291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ba74a-6555-4931-8e87-a9861b176080 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.414454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.425637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.426242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.426524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.426797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.427525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:09.427738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.429154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.438123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.444709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 254/507] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:09.444709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.453957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.455430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.544611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda94e8-b306-4ec1-a47d-bf0836af3c6d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.556396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 254/508] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:09.557221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.577473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.578081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.578360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.578639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.579299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:09.579600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.581014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.589599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 255/509] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:09.590398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.636079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.647535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.663840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd834-f2f1-46bd-aa42-2d9f5c1ef144 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.689048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907ac0-d3eb-4726-8c2c-539b33f18ae5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.696300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.696897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.697175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.697448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.723698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.724456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.724629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.724898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.735012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.736493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:09.750292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:09.751167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:09.752296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:09.752296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:09.752296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:09.752296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 256/510] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:09.752296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.763264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.764760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.842787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.844680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:09.850304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788631a-d68c-4736-9064-7964563851d3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:09.867079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 255/511] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:09.867956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.889376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:09.890015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:09.890361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:09.890555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:09.898839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:09.900326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:09.911223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:09.912210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:09.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 257/512] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:09.913721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:09.976201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67c11f-6507-4b07-a659-7ab249f88b9e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.010179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.010791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.011070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.011337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.014653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039ead-9b2c-444e-a418-410dd4cb03d5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.021750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.023202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:10.037302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:10.038348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:10.043654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:10.043654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:10.043654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:10.043654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 256/513] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:10.043654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.054127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.054754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.055031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.055298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.065652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.067656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.073339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:10.081827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:10.082783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:10.083610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:10.083610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:10.083610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:10.083610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 258/514] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:10.083831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.097748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.137358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb286d-fef0-45ff-9524-e2846975e949 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.169241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.169837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.170115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.170389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.171017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:10.171322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.172811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.185293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 257/515] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:10.186067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.186661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c640c1-c1f8-4f95-a8d2-c99dd95324f2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.221481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.222136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.222419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.222695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.236136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.239326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:10.255853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:10.257309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:10.258258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:10.258258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:10.258258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:10.258258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 259/516] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:10.258258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.278125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.284408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e640b-a0bb-48b2-bd5c-60f7a0a57cc0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.318274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.319615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.320227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.320662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.320960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.321742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:10.322051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.323481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.344661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 258/517] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:10.344661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.359102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a4b2-a3bf-4025-827c-e7a317a1c0e0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.393265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.393876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.394184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.394462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.395108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:10.395412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.396831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.408065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 260/518] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:10.408916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.439521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16c34-ff69-4772-b622-5aa2470887e3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.471643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.472787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.473063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.473336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.473971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:10.474273 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.475648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.486691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 259/519] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:10.487519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.503210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.507835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafef6e-366b-44fa-b782-ca20225ebbe9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.527104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.542925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.543537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.543819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.544094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.544777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.546217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.572909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 261/520] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:15:10 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:10.574346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.605330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e093fe-38a6-49b8-97d4-f1b1e1879a8a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.657065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.657677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.658030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.658357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.659004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:10.659307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.661252 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.676755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 260/521] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:10.677810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.723866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeaa24-9bc0-4afb-8279-73ae29d92e03 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.759351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.763080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.763691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.763971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.764235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.787964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a7f9-b6a5-49c0-be33-7412871b02a6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:10.817433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:10.826639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:10.827225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:10.827505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:10.827779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:10.835982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.837527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.844158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:10.845664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:10.850470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:10.851323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:10.852141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:10.856970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 261/522] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:10.857222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.959360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 262/523] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:10.959360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:10.973641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ccd2e-fdf0-41e2-af6e-1c4ebeb55436 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.009568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.010657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.011020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.011448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.013359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.020764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.022930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:11.036064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:11.037000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:11.037874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 262/524] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:11.039734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.046640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.076018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2711e-4393-4408-82eb-86fae3c54cb5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.116089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.116745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.117028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.117453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.124684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.126128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:11.137839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:11.138686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:11.139556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 263/525] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:11.140031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.156429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090208f-ee89-4822-becc-3dfebf7c5038 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.192493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.193099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.193378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.193651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.194333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:11.194637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.196067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.214382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 263/526] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:11.215148 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.257400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedf10-7922-4cef-9e06-8ef1ec36356e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.271685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.294426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.295100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.295331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.295609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.298650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.310491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.312628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.318260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b17456-bc13-4ba1-820b-4e96d3052d87 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:11.328555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:11.329514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:11.330347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:11.330347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:11.330347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:11.332567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 264/527] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:11.333311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.360599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.361873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.362304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.362983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.364002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:11.364780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.366672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.387856 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 264/528] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:11.388720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.441709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5d20-1ecf-48a8-aafa-f5377b0f7c79 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.478901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.479544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.479824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.480106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.480833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:11.481142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.482600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.496846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c777af-6c3b-45d2-9e25-c2fe380a244d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.509129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 265/529] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:11.509129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.518300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.543760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.544525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.544807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.545082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.545809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=c83d5e7a41404bacb2b4d18daf040aa0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:11.546117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.547560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.562828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 265/530] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/role_assignments?user.id=c83d5e7a41404bacb2b4d18daf040aa0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:11.562828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.584518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.644469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e01b2e-0b1c-4a90-bbe6-15ecd91e94fd None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.682801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.683422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.683698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.683966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.684658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:11.684957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.686419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.699735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 266/531] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:11.700641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.708800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b58d0-0d70-46c0-b2fd-2e0443934353 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.748336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511c412-5702-4932-933b-eff491e223bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.749127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511c412-5702-4932-933b-eff491e223bf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.749409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511c412-5702-4932-933b-eff491e223bf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.749683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511c412-5702-4932-933b-eff491e223bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.800332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.823643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661566ce-79cc-4b28-83bf-ae0a122158a9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:11.826178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511c412-5702-4932-933b-eff491e223bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.827654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511c412-5702-4932-933b-eff491e223bf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.836668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:11.871085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:11.872217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:11.872942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:11.873310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:11.874186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=6d280ee7087f43a3a7e4c4940a8f23af) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:11.874592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:11.876328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:11.887447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 267/532] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/role_assignments?user.id=6d280ee7087f43a3a7e4c4940a8f23af&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:11.887447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:11.999189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 266/533] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:12.005713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511c412-5702-4932-933b-eff491e223bf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:12.080912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35f8a-bc9c-4296-8744-0b67a192989b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:12.125671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:12.126634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.127091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.127553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.133265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:12.138861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:12.140903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:12.159375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:12.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:12.161191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:12.161605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511c412-5702-4932-933b-eff491e223bf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:12.161676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 268/534] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:12.167696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:12.200462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:12.201093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.201371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.201643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.223960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:12.225482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:12.228833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:12.256235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:12.257204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:12.258034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:12.258034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:12.258034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:12.258034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 267/535] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:12.268130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:12.377349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608d7dd-210f-4d1f-b404-74fe3f4a29e6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:12.426595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:12.427341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.427626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.427902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.428620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:12.428925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:12.430265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d45aa3-6fd6-4804-91cd-5f128c24300a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:12.430388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:12.448064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 269/536] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:12.449452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:12.480658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:12.492592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:12.493270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.493547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.493818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.494522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:12.494830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:12.496225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:12.524820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 268/537] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:12.525671 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:12.632637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:12.650259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706c65-a5a7-4179-8033-73b5db7270d8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:12.713805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d8b3-d583-4d0f-a015-c2f6db602e6e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:12.727206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:12.727838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.728118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.728416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.729165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=0d585fa74ead490abff52d8b03f850fa) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:12.729478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:12.731066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:12.743108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 270/538] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:12 2022] GET /identity/v3/role_assignments?user.id=0d585fa74ead490abff52d8b03f850fa&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:12.766430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0553fa-bce1-4c63-92d4-db6fece7c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:12.767077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0553fa-bce1-4c63-92d4-db6fece7c6cc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.767427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0553fa-bce1-4c63-92d4-db6fece7c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.767707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0553fa-bce1-4c63-92d4-db6fece7c6cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.776578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0553fa-bce1-4c63-92d4-db6fece7c6cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:12.778046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0553fa-bce1-4c63-92d4-db6fece7c6cc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2c0553fa-bce1-4c63-92d4-db6fece7c6cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:12.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:12.791443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:12.792305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 269/539] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:12.797761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:12.820265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f2ef-080a-48fb-b00d-19fee4d21a31 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.820604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f2ef-080a-48fb-b00d-19fee4d21a31 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.820865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f2ef-080a-48fb-b00d-19fee4d21a31 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.822474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 270/540] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:12.828048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040bbd-dcbe-4e81-869a-fdaf1d5bb4d9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:12.828377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040bbd-dcbe-4e81-869a-fdaf1d5bb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:12.828656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040bbd-dcbe-4e81-869a-fdaf1d5bb4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:12.856010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4d040bbd-dcbe-4e81-869a-fdaf1d5bb4d9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:12.857307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4d040bbd-dcbe-4e81-869a-fdaf1d5bb4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:12.956689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:12.990839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b92cd8-a517-4e1e-aaf9-c95657316c8b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:13.005806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 271/541] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:13.039617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:13.040152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:13.040525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:13.040800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:13.041547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:13.041909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:13.043424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:13.060496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 271/542] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:13.062412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040bbd-dcbe-4e81-869a-fdaf1d5bb4d9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:13.198995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040bbd-dcbe-4e81-869a-fdaf1d5bb4d9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:13.245057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:13.245663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:13.245943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:13.246214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:13.246937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=f354351c3e9d41d09ea2610b47cefa0c) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:13.247246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:13.248974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:13.260536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 272/543] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:13 2022] GET /identity/v3/role_assignments?user.id=f354351c3e9d41d09ea2610b47cefa0c&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:13.466162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:13.491712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:13.608313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb710e3-beff-4f07-9525-26f1bba86f8d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:13.652340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:13.652984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:13.653268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:13.653544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:13.670737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:13.676015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:13.676929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:13.677721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 272/544] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:13.683360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:13.764645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:13.849373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec3d16-ea5e-4e10-9585-f1964bcc76c1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:13.894406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:13.895023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:13.895303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:13.895570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:13.896234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:13.896567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:13.897934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:13.907076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 273/545] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:13.912541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:14.027111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:14.058068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ab09c-7cdf-4588-8543-df6a5744a7be None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:14.100107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79aed2-4d78-4ca8-bc66-452243ecc3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:14.100819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79aed2-4d78-4ca8-bc66-452243ecc3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.101102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79aed2-4d78-4ca8-bc66-452243ecc3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.101377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79aed2-4d78-4ca8-bc66-452243ecc3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.116947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79aed2-4d78-4ca8-bc66-452243ecc3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:14.118397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79aed2-4d78-4ca8-bc66-452243ecc3e5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-8f79aed2-4d78-4ca8-bc66-452243ecc3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:14.137776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:14.138694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:14.139527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:14.139527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:14.139527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:14.139527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 273/546] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:14.149375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:14.161250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325518b-787e-4c99-934d-23baebac7e6e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.161535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325518b-787e-4c99-934d-23baebac7e6e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.161809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325518b-787e-4c99-934d-23baebac7e6e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.163364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 274/547] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:14.168473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32776df2-107f-4726-be89-a63fad985120 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.168756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32776df2-107f-4726-be89-a63fad985120 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.169027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32776df2-107f-4726-be89-a63fad985120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.193904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-32776df2-107f-4726-be89-a63fad985120 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:14.195107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-32776df2-107f-4726-be89-a63fad985120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:14.277072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5a33-ed8b-4e13-8e1f-bf7b72d786b0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:14.279650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:14.314359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:14.314963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.315239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.315508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.316690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:14.316988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:14.318522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:14.326642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 275/548] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:14.335703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 274/549] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:14.341006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32776df2-107f-4726-be89-a63fad985120 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:14.428213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:14.483503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32776df2-107f-4726-be89-a63fad985120 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:14.534875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560bba4-6d5c-4faa-9f43-b8273b8bc403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:14.535431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560bba4-6d5c-4faa-9f43-b8273b8bc403 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.535711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560bba4-6d5c-4faa-9f43-b8273b8bc403 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.535984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560bba4-6d5c-4faa-9f43-b8273b8bc403 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.543340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560bba4-6d5c-4faa-9f43-b8273b8bc403 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:14.544879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560bba4-6d5c-4faa-9f43-b8273b8bc403 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-d560bba4-6d5c-4faa-9f43-b8273b8bc403 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:14.557276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:14.559224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:14.560490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 276/550] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:14.565544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:14.591781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65edf3-4f95-4feb-b4af-469f2c6ec0c9 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.592074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65edf3-4f95-4feb-b4af-469f2c6ec0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.592333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65edf3-4f95-4feb-b4af-469f2c6ec0c9 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.595141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 277/551] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:14.612310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4132b3-aa76-4a91-b73b-5dbabfccc4c8 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.612310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4132b3-aa76-4a91-b73b-5dbabfccc4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.612310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4132b3-aa76-4a91-b73b-5dbabfccc4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.639882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8c4132b3-aa76-4a91-b73b-5dbabfccc4c8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:14.641120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8c4132b3-aa76-4a91-b73b-5dbabfccc4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:14.706737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505e96b-296a-45ec-906e-5ee2d0d507e8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:14.732690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 278/552] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:15:14.742376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4132b3-aa76-4a91-b73b-5dbabfccc4c8 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:14.751606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:14.752227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.752541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.752813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.753582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:14.753887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:14.755330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:14.792075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 275/553] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 21 05:15:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:14.796940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:14.836800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:14.837429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:14.915331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c988b-b6b0-4e36-a215-4f7fb5600577 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:14.959038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:14.959668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:14.959952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:14.960230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:14.992812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4132b3-aa76-4a91-b73b-5dbabfccc4c8 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.049216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.050290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.050671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.051232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.061900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:15.063243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.064914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:15.068032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:15.068985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:15.069791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:15.074211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 279/554] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:15.075075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.096361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:15.193811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655507f2-4b65-4b29-8f6a-49354ac2229f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.202090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 276/555] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 05:15:15.203125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.208297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:15.244628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.245269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.245608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.245887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.260863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:15.267069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:15.268036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 280/556] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:15.274973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.331567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ac551-2d41-4176-9576-c553c4f1422c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.363877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:15.383117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.383920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.384344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.384631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.385316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:15.385618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.387427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.397615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164273-96ec-46d9-80e6-ea78a85ec01a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.403496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 277/557] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:15.403496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.440371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.442066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.442554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.443445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.456010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.457962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:15.473735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:15.474704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:15.475580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:15.475580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:15.475580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:15.477901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 281/558] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:15.478926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.502428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:15.520021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bed757-2ace-4edf-892e-28690968aa01 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.553167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.553797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.554127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.554430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.555130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:15.555431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.557037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.570321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 278/559] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:15.570321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.589904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d022f-66e6-4ae7-8cbb-d902892f477a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.615069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:15.627960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cd8ef-0514-4941-9a64-7a462e417fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.629155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd8ef-0514-4941-9a64-7a462e417fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.629487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd8ef-0514-4941-9a64-7a462e417fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.629763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd8ef-0514-4941-9a64-7a462e417fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.640903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cd8ef-0514-4941-9a64-7a462e417fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.642488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cd8ef-0514-4941-9a64-7a462e417fe4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-593cd8ef-0514-4941-9a64-7a462e417fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:15.658368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:15.659293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:15.661121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:15.661121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:15.661121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:15.661121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 282/560] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:15.661624 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe10bc-416c-43dd-a390-7173bc7ab5e3 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.661912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe10bc-416c-43dd-a390-7173bc7ab5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.662241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe10bc-416c-43dd-a390-7173bc7ab5e3 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.663605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 283/561] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:15.668431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe10bc-416c-43dd-a390-7173bc7ab5e3 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.683111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d129dfa-d26b-4f5b-a2a0-73a1f69b3df1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.721127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.721744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.722595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.722820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.723465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:15.723944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.725179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.737642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 279/562] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:15.738858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.755790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:15.791162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe10bc-416c-43dd-a390-7173bc7ab5e3 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.824574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44225-3870-40cf-bb6a-efc8a5e3ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.825194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44225-3870-40cf-bb6a-efc8a5e3ea66 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.825471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44225-3870-40cf-bb6a-efc8a5e3ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.825741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44225-3870-40cf-bb6a-efc8a5e3ea66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.835793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44225-3870-40cf-bb6a-efc8a5e3ea66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.837318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44225-3870-40cf-bb6a-efc8a5e3ea66 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.846104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101ec1f-b0c8-4436-b033-8501b76eaac2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:15.854417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-adf44225-3870-40cf-bb6a-efc8a5e3ea66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:15.854543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:15.855423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:15.861423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:15.861423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:15.861423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:15.861423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 284/563] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:15.861423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c4e1-7914-48de-9069-31b107647320 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.861423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c4e1-7914-48de-9069-31b107647320 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.861423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c4e1-7914-48de-9069-31b107647320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.877353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4d33c4e1-7914-48de-9069-31b107647320 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:15.878563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4d33c4e1-7914-48de-9069-31b107647320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:15.886134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:15.886732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.887008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.887277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.887898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:15.888198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:15.889587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:15.900243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 280/564] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:15.901042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:15.948672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 285/565] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:15.949920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d377-f2c6-4f0e-ac7d-25649115f88d None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:15.950212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d377-f2c6-4f0e-ac7d-25649115f88d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:15.950488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d377-f2c6-4f0e-ac7d-25649115f88d None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:15.951722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 286/566] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:15.952484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d377-f2c6-4f0e-ac7d-25649115f88d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.007050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7ee5-6413-48c7-b787-b267b4a97ffa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.019977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.042840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.043470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.043750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.044408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.052018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.053525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:16.064963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:16.065883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:16.066759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:16.070849 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 281/567] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:16.071522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.071876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d377-f2c6-4f0e-ac7d-25649115f88d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.100341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.112815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0890a0-d667-4d33-ba9f-cc493e25eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.113673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0890a0-d667-4d33-ba9f-cc493e25eee6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.114111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0890a0-d667-4d33-ba9f-cc493e25eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.114584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0890a0-d667-4d33-ba9f-cc493e25eee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.115364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0890a0-d667-4d33-ba9f-cc493e25eee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:16.115819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0890a0-d667-4d33-ba9f-cc493e25eee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.117407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0890a0-d667-4d33-ba9f-cc493e25eee6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.130963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 287/568] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:16.132379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0c67-47c5-4716-8910-a4f11e9cd9c6 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.132665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0c67-47c5-4716-8910-a4f11e9cd9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.132941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f0c67-47c5-4716-8910-a4f11e9cd9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.152240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-997f0c67-47c5-4716-8910-a4f11e9cd9c6 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:16.153851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-997f0c67-47c5-4716-8910-a4f11e9cd9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:16.178219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369fe3-c6dd-40c3-9343-e276b19ad0f9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.212554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.213179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.213460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.213730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.222787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.224106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 288/569] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:16.224386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.224970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f0c67-47c5-4716-8910-a4f11e9cd9c6 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:16.235316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:16.236337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:16.237269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 282/570] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:16.237906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.275242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.329172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f0c67-47c5-4716-8910-a4f11e9cd9c6 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.334688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.349166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db4fe-6599-4bdb-8f45-11aa9eb70a10 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.364348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.364919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.365201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.365475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.366167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:16.366488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.367898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.379973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 289/571] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:16.384222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.385167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.385459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.385559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.385734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.393564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.395675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:16.407641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:16.408594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 283/572] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:16.410165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.494233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e8bb7-731d-4b95-90ca-182c719cc5b3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.496995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.514247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed93320-bb6e-4967-8648-9bc9d336922b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.528448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.529070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.529347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.529615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.539444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:16.544689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:16.545656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:16.546494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 290/573] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:16.547195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.551228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.551839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.552120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.552422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.553146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:16.553502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.554929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.572370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 284/574] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:16.573180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.579071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.648517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc72fb-49b6-41df-bd1e-6dd953c94a83 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.672484 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4afa-e796-47a8-b977-c727f26f1303 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.680256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.680883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.681165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.681441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.682166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=1bc038af597c45648f6603d2ef6d685c) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:16.682474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.684016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.689345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 291/575] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/role_assignments?user.id=1bc038af597c45648f6603d2ef6d685c&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:16.690125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.708418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.709051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.709330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.709624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.710346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:16.710655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.712128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.723769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.736149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 285/576] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:16.736149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.804813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.814400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f550e2-50f9-4d3f-af88-b580cf6c3160 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.852400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8379257-17d9-47de-ab78-46b785fdb063 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:16.856676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.856676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.856676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.856676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.870948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:16.876449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:16.877373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:16.878820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 292/577] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:16.879515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.898220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:16.899261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:16.899562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:16.899843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:16.900538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:16.900844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:16.902227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:16.915306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 286/578] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:16.915306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:16.970451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:16.985158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0481-68c4-4347-9484-9da41b19a88b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.022772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.023501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.023780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.024052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.025042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941e5c-e5ac-4555-9870-988ecfb99287 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.036534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.037988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.049370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:17.053300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:17.054482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:17.055404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:17.055404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.055404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:17.055404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 293/579] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:17.055404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.066351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.066973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.067250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.067518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.077873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.079299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:17.094077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:17.095029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:17.096003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:17.096003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.096003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:17.096003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 287/580] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:17.096003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.171498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84b04-0bb6-49f4-af7e-5d6a9f46da96 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.202921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecaf03-8054-4311-b6c4-c93ef2a1ed08 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.208631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.209245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.209525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.210208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.210875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:17.211183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.212941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.222345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 294/581] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:17.227321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.230000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:17.238541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.239175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.239460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.239963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.250916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.252387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:17.266381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:17.267292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:17.268179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:17.268179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.268179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:17.268179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 288/582] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:17.268179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.298181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:17.341669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156334b4-5cc4-4d22-b1eb-0287200d9248 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.377487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.378117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.378321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc14104-025a-469b-a445-ed6598b44e84 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.378770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.378770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.379274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:17.379573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.380986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.393185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 295/583] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:17.394035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.420218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.420854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.421137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.421407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.422088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:17.422333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.423695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.436889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 289/584] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:17.437599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.463768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:17.507707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb1d7-dfc7-40f3-a7c7-385225e5b6cf None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.525252 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:17.538653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd896e63-616a-48ce-b67f-0817726e886b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.542749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.543392 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.543672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.543944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.555970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.557999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:17.574653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:17.575667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:17.576587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:17.576587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:17.576587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:17.576587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 296/585] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:17.576587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.579344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.580029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.580650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.580922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.582085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:17.582382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.583755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.595485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 290/586] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:17.596204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.694082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76430-7d43-4a47-b304-a8aa554c18d6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.698059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c91dc-a454-4477-b17a-766a749d3026 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.708980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:17.730803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.731429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.731709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.731983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.734301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.735113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.735568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.736012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.738723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.740168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.743792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.745424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:17.751382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:17.752452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:17.753573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:17.757323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 297/587] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:17.758159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:17.760258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:17.761299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:17.762249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:17.769208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 291/588] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:17.769967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.781398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:17.876331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e958153-7783-4b93-828d-56a931b5f611 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.876508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ede91-ca1c-42ca-b732-ac4021355fc4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:17.910814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.911427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.911699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.911975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.912695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:17.912971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.914385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.915006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:17.915637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:17.915917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:17.916189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:17.923626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:17.925100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:17.927812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 298/589] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:17.933082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:17.936030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:17.936970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:17.937885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 292/590] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:17.938470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:17.973950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.010836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.046409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b7e65-8f6f-4324-9806-2ed5376e9978 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.050625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837ee7-2e26-4799-909b-99101707c295 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.080198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.080823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.081097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.081717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.082401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:18.082705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.084116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.086855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.087458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.087740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.088013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.088723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:18.089030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.090428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.101220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 293/591] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:18.101220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.107667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 299/592] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:18.108427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.206957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e940b0d-6600-46de-b9be-74dcd9da1a00 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.213766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.222474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396678ff-91be-470f-9ebf-44f28d884dfc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.235381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.244365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.244947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.245224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.245501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.253590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.255026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.259265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.260031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.260478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.260911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.261769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:18.262215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.263743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:18.266581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:18.267493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 294/593] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:18.268478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.286284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 300/594] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 05:15:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:18.287418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.380714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be973a68-9efb-41ca-9ace-a9cbaf75cf01 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.388473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990363-89ee-423b-b394-3084fc9e513f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.416765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.417691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.418175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.418741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/6d280ee7087f43a3a7e4c4940a8f23af/roles/ed997874e38746a3992f92bfdfabfeec` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.423345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.424005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.424309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.424591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/c83d5e7a41404bacb2b4d18daf040aa0/roles/ed997874e38746a3992f92bfdfabfeec` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.434129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=6d280ee7087f43a3a7e4c4940a8f23af, role_id=ed997874e38746a3992f92bfdfabfeec)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.435580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.439338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=c83d5e7a41404bacb2b4d18daf040aa0, role_id=ed997874e38746a3992f92bfdfabfeec)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.441726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.449639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 295/595] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:18 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/6d280ee7087f43a3a7e4c4940a8f23af/roles/ed997874e38746a3992f92bfdfabfeec => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:18.450776 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.466468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 301/596] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:18 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/c83d5e7a41404bacb2b4d18daf040aa0/roles/ed997874e38746a3992f92bfdfabfeec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:18.467851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.483913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.535077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.674388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23612-ad41-4040-9c18-65e059e942bb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.686797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb841-8d51-4d3c-b570-a876ccf7ce9f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.715192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.716106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.716616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.717081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.717994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:18.718515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.720160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.741410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 296/597] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 21 05:15:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:18.747967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.748147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.748875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.749160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.749438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.769872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.771353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:18.797915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:18.798932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:18.799927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:18.799927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:18.799927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:18.799927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 302/598] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:18.806032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.865364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.872194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8216125-be31-4ef0-8436-34b014a853c3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:18.922732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dcb18-5cef-4439-893c-73862b1979cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:18.923385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcb18-5cef-4439-893c-73862b1979cb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.923668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcb18-5cef-4439-893c-73862b1979cb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.923943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcb18-5cef-4439-893c-73862b1979cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.928625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:18.944838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dcb18-5cef-4439-893c-73862b1979cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:18.948554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dcb18-5cef-4439-893c-73862b1979cb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-222dcb18-5cef-4439-893c-73862b1979cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:18.964451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:18.965427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:18.966337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:18.966337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:18.966337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:18.966337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 297/599] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:18.967810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636d64-1e7e-4d97-99aa-87b39d0b327e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:18.968184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636d64-1e7e-4d97-99aa-87b39d0b327e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:18.968571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636d64-1e7e-4d97-99aa-87b39d0b327e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:18.974749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 298/600] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:18.975723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636d64-1e7e-4d97-99aa-87b39d0b327e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:18.985548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330df5c-68c5-4ea8-9c99-4b0e75253626 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.021441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa9e12-b139-4180-8457-bd0cb3e94d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.022055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa9e12-b139-4180-8457-bd0cb3e94d3f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.022336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa9e12-b139-4180-8457-bd0cb3e94d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.022603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa9e12-b139-4180-8457-bd0cb3e94d3f None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.023742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa9e12-b139-4180-8457-bd0cb3e94d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:19.024054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa9e12-b139-4180-8457-bd0cb3e94d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:19.025497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa9e12-b139-4180-8457-bd0cb3e94d3f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:19.040662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 303/601] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:19.041994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64703096-d4f2-4dde-b2eb-7bd70eb5564b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.042287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64703096-d4f2-4dde-b2eb-7bd70eb5564b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.042562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64703096-d4f2-4dde-b2eb-7bd70eb5564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.062660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-64703096-d4f2-4dde-b2eb-7bd70eb5564b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:19.064371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-64703096-d4f2-4dde-b2eb-7bd70eb5564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:19.123639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636d64-1e7e-4d97-99aa-87b39d0b327e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.145664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 304/602] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:19.147268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64703096-d4f2-4dde-b2eb-7bd70eb5564b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.186380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.188672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.189008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.189288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.189924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:19.192555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:19.193977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:19.221099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 299/603] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:19.227260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.253171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:19.262294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:19.361670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408f4c9-b9b8-4f7c-9afe-6189382ba9a8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.382406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64703096-d4f2-4dde-b2eb-7bd70eb5564b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.432931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.434449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.435796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.437066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.450672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:19.453303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:19.454093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.454904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.455324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.455738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.464076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:19.465784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:19.469617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:19.470561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:19.471445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 300/604] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:19.472509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:19.481504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:19.482407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:19.483275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:19.485727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 305/605] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:19.486793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.549129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:19.589501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16c4d-67d7-4344-8129-ac12c3e3a7b8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.607411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f6ea-1017-4f71-9fc6-00c764a031da None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.610095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:19.644390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.644390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.644390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.644390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.647675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:19.652843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:19.653748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:19.654573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 301/606] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:19.655264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.660213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.661106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.661589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.662081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.663034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:19.663349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:19.664930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:19.686970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 306/607] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:19.687888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.767095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4ae8-9d88-4f0f-a8e2-39681e39d127 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.793551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180701-5060-4b7a-883f-1c5cf52b3058 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.797030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:19.808164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.809091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.809684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.810182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.811016 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:19.811464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:19.813203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:19.828272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 302/608] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:19.829408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.832030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.832697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.832978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.833265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.833932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:19.834238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:19.835721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:19.849187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 307/609] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:19.850598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:19.881381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:19.952556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985e73-0f07-4d29-8d40-52a4fbee6b51 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.958129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b6fe0-7e80-4180-a2e1-3506d74c9de2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:19.990162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.991056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.991482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.991900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/f354351c3e9d41d09ea2610b47cefa0c/roles/ed997874e38746a3992f92bfdfabfeec` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:19.993397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:19.994162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:19.994547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:19.994948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/0d585fa74ead490abff52d8b03f850fa/roles/ed997874e38746a3992f92bfdfabfeec` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.009520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=f354351c3e9d41d09ea2610b47cefa0c, role_id=ed997874e38746a3992f92bfdfabfeec)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:20.011225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:20.011342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=0d585fa74ead490abff52d8b03f850fa, role_id=ed997874e38746a3992f92bfdfabfeec)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:20.012920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:20.032560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 303/610] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:19 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/f354351c3e9d41d09ea2610b47cefa0c/roles/ed997874e38746a3992f92bfdfabfeec => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:20.033753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:20.039509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 308/611] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:19 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/0d585fa74ead490abff52d8b03f850fa/roles/ed997874e38746a3992f92bfdfabfeec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:20.085862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:20.163056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310ec12-c022-428d-b85b-d5cefe278f3c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:20.204121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:20.205051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:20.205508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:20.205927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.218151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:20.219879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:20.238762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:20.239976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:20.241123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:20.241123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:20.241123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:20.242904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 304/612] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:20.249270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:20.344630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:20.364207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c664-693f-4fd6-99c9-53f54742ba81 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:20.400523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:20.401165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:20.401426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:20.401701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.402347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:20.402720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:20.404098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:20.416958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 309/613] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:20.422504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:20.519079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:20.529042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64545e-677e-444b-b63a-77d239dfcb4c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:20.565688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:20.566323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:20.566602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:20.566886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.575380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:20.576377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:20.590951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:20.592007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:20.593058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 305/614] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:20.600514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:20.715940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f0a40-80bb-4596-b789-5c9bfa45b9f4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:20.752111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78809bf-d84d-44c5-8d80-53188b9545b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:20.752761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78809bf-d84d-44c5-8d80-53188b9545b8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:20.753075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78809bf-d84d-44c5-8d80-53188b9545b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:20.753351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78809bf-d84d-44c5-8d80-53188b9545b8 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.754081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78809bf-d84d-44c5-8d80-53188b9545b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:20.754386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78809bf-d84d-44c5-8d80-53188b9545b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:20.755834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78809bf-d84d-44c5-8d80-53188b9545b8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:20.758561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:20.777600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 310/615] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 21 05:15:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:20.779853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:20.883632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d07ee-386a-49d9-a00c-993f09571a2b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:20.889961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105cd8a-a665-41fa-a254-3d3b09396ec4 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:20.890249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105cd8a-a665-41fa-a254-3d3b09396ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:20.890516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105cd8a-a665-41fa-a254-3d3b09396ec4 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.891850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 311/616] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:20.897940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e91489-07cb-456e-9c31-a3f1af0181ce None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:20.898235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e91489-07cb-456e-9c31-a3f1af0181ce None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:20.898515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e91489-07cb-456e-9c31-a3f1af0181ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.932492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:20.933142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:20.933420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:20.933696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:20.936309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-29e91489-07cb-456e-9c31-a3f1af0181ce None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:20.937854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-29e91489-07cb-456e-9c31-a3f1af0181ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:20.955079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:20.959394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:20.988978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:20.989991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:20.990885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:20.990885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:20.990885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:20.992465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 306/617] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:21.001984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:21.028710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:21.083674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 312/618] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:15:21.143663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ffa99-39e1-4ae2-aed4-652291b66196 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:21.189482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff92a99-a203-41e0-84f2-abf5d8852daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:21.190164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff92a99-a203-41e0-84f2-abf5d8852daa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:21.190971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff92a99-a203-41e0-84f2-abf5d8852daa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:21.191260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff92a99-a203-41e0-84f2-abf5d8852daa None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:21.192039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff92a99-a203-41e0-84f2-abf5d8852daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:21.192369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff92a99-a203-41e0-84f2-abf5d8852daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:21.193794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff92a99-a203-41e0-84f2-abf5d8852daa None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:21.215522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 307/619] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:21.220954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e91489-07cb-456e-9c31-a3f1af0181ce None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:21.318297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c3ff0-912a-423f-9f77-1f316873c649 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:21.318930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c3ff0-912a-423f-9f77-1f316873c649 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:21.319437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c3ff0-912a-423f-9f77-1f316873c649 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:21.322304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 308/620] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:21.326454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f290c3-aa67-42d4-849c-087db90e0630 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:21.326967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f290c3-aa67-42d4-849c-087db90e0630 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:21.327595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f290c3-aa67-42d4-849c-087db90e0630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:21.348701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-88f290c3-aa67-42d4-849c-087db90e0630 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:21.350829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-88f290c3-aa67-42d4-849c-087db90e0630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:21.370330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e91489-07cb-456e-9c31-a3f1af0181ce None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:21.413394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:21.428308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:21.428308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:21.428308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:21.428308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:21.433519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:21.434976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:21.446900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:21.447811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:21.449094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 313/621] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:21.454918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:21.457009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:21.476801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 309/622] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:15:21.533218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f290c3-aa67-42d4-849c-087db90e0630 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:21.607070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3d9c7-77c9-45da-88f9-6ad1d7045f09 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:21.646367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:21.647030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:21.647325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:21.647599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:21.648306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:21.648617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:21.650052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:21.663697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 314/623] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:21.669438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:21.721426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:21.755020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f290c3-aa67-42d4-849c-087db90e0630 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:21.776721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3c33-ff24-4c4f-8ecc-1c4507149ea0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:21.810575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:21.811249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:21.811531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:21.811808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/1bc038af597c45648f6603d2ef6d685c/roles/ed997874e38746a3992f92bfdfabfeec` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:21.824982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:21.825631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:21.825980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:21.826259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:21.827729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=1bc038af597c45648f6603d2ef6d685c, role_id=ed997874e38746a3992f92bfdfabfeec)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:21.829196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:21.846123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 315/624] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:21 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/1bc038af597c45648f6603d2ef6d685c/roles/ed997874e38746a3992f92bfdfabfeec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:21.850859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:21.861186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:21.862163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:21.863494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 310/625] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:21.869031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:21.882010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:21.979383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:21.988712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:21.997886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2455b3-e980-4f24-ad58-7314315e6e19 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.078266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff106c-53d1-4c3a-9a93-d15a500f383e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.079622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.080260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.080586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.080859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.083058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:22.083409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:22.085835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:22.107088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 316/626] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:22.112050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:22.145319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.146082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.146496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.146873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.159763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:22.165763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:22.166685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:22.167687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 311/627] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:22.173261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:22.263117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c1e6-6c91-4648-a80e-4f61e11f68dc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.301605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.302251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.302531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.302807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.315185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:22.317343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:22.333521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:22.334482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:22.336023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:22.336023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:22.336023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:22.336023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 317/628] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:22.340682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:22.353055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:22.453428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2237a-a638-4ab8-ad1f-e9ae39d06e88 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.466239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f814d4-1a14-404d-af49-d3ee225bdee9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.492454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.493091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.493381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.493650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.494321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:22.494628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:22.496133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:22.511089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 318/629] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:22.514295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:22.521123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:22.561553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.562222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.562429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.562704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.563381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:22.563684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:22.567879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:22.588056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 312/630] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:22.592725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:22.637650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:22.679323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbafb-d690-4f80-8d89-301f124ebd43 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.716175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1b281-239d-4460-8c0c-7df22e185dd7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.728001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4232-5ce9-4d62-bc71-55e533c67909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.728707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4232-5ce9-4d62-bc71-55e533c67909 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.728984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4232-5ce9-4d62-bc71-55e533c67909 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.729686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4232-5ce9-4d62-bc71-55e533c67909 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.739725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4232-5ce9-4d62-bc71-55e533c67909 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:22.742102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4232-5ce9-4d62-bc71-55e533c67909 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:22.754985 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4713e68-0bc9-4b78-be90-4e50d9890185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.755619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4713e68-0bc9-4b78-be90-4e50d9890185 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.755947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4713e68-0bc9-4b78-be90-4e50d9890185 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-dc4d4232-5ce9-4d62-bc71-55e533c67909 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:22.756116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:22.758236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 05:15:22.760027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:22.760817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4713e68-0bc9-4b78-be90-4e50d9890185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.760956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 319/631] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:22.760956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89928d64-b252-4e02-8a59-d379505016a1 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.760956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89928d64-b252-4e02-8a59-d379505016a1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.760956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89928d64-b252-4e02-8a59-d379505016a1 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.761507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 320/632] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:22.767286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89928d64-b252-4e02-8a59-d379505016a1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:22.770309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4713e68-0bc9-4b78-be90-4e50d9890185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:22.771783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4713e68-0bc9-4b78-be90-4e50d9890185 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c4713e68-0bc9-4b78-be90-4e50d9890185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:22.787434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:22.789747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:22.791773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:22.791773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:22.791773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:22.791773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 313/633] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:22.791773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329c76-75e5-4175-96b8-e0e730fcb48c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.791773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329c76-75e5-4175-96b8-e0e730fcb48c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.791773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329c76-75e5-4175-96b8-e0e730fcb48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.809847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e7329c76-75e5-4175-96b8-e0e730fcb48c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:22.811093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e7329c76-75e5-4175-96b8-e0e730fcb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:22.833105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:22.883966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 314/634] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:22.885059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7329c76-75e5-4175-96b8-e0e730fcb48c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:22.892038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89928d64-b252-4e02-8a59-d379505016a1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:22.926913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:22.940063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae059fa-2b5a-428d-a0e7-88a41a1bd589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:22.941093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae059fa-2b5a-428d-a0e7-88a41a1bd589 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.941531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae059fa-2b5a-428d-a0e7-88a41a1bd589 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.941948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae059fa-2b5a-428d-a0e7-88a41a1bd589 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.942932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae059fa-2b5a-428d-a0e7-88a41a1bd589 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:22.943403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae059fa-2b5a-428d-a0e7-88a41a1bd589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:22.945082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae059fa-2b5a-428d-a0e7-88a41a1bd589 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:22.965462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 321/635] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:22.967002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c649-7297-46fc-b97c-f8ef491d9400 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:22.967452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c649-7297-46fc-b97c-f8ef491d9400 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:22.967870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c649-7297-46fc-b97c-f8ef491d9400 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:22.969567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 322/636] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:22.970929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c649-7297-46fc-b97c-f8ef491d9400 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.014098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7329c76-75e5-4175-96b8-e0e730fcb48c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.060850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e252e-2977-48e2-bb23-fe06245b28f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.061723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e252e-2977-48e2-bb23-fe06245b28f0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.062008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e252e-2977-48e2-bb23-fe06245b28f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.062279 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e252e-2977-48e2-bb23-fe06245b28f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.062909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e252e-2977-48e2-bb23-fe06245b28f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:23.063210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e252e-2977-48e2-bb23-fe06245b28f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:23.065259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e252e-2977-48e2-bb23-fe06245b28f0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:23.082209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c649-7297-46fc-b97c-f8ef491d9400 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.082382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 315/637] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:23.083646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cc19-1340-4d4c-bcaa-fbf8d0e5fe8a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.083936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cc19-1340-4d4c-bcaa-fbf8d0e5fe8a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.084211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cc19-1340-4d4c-bcaa-fbf8d0e5fe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.107482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-23e9cc19-1340-4d4c-bcaa-fbf8d0e5fe8a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:23.108973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-23e9cc19-1340-4d4c-bcaa-fbf8d0e5fe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:23.121523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.122613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.123140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.123398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.123707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.183941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 316/638] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:23.185067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9cc19-1340-4d4c-bcaa-fbf8d0e5fe8a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.192855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.210015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:23.211639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:23.319833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9cc19-1340-4d4c-bcaa-fbf8d0e5fe8a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.322909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 323/639] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 05:15:23.323978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.356727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.357382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.357792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.358066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.365727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:23.367181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:23.380701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:23.381864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 317/640] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:23.382996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.392087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.425644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.445095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d80c-201f-4534-9724-eacc8f86435b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.485498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.486132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.486411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.486685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.496956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:23.501573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4b723-7aed-46c6-9f34-c7ef82fea946 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:23.502083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:23.503524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:23.504388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:23.508650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 324/641] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:23.509495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.536615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.537237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.537515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.537787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.547932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:23.549441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:23.563687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:23.565136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:23.566687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:23.566687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:23.566687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:23.569805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 318/642] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:23.570765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.617663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e24bdb-6a5c-4fcb-a68b-1c7c55bb8853 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.628799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.654238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.654639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.654917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.655184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.655894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:23.656195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:23.657809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:23.672677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0913b-d2df-4885-b6da-bfc3c8dae286 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.676035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 325/643] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:23.678285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.682425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.713838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.714468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.714756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.715027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.725702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:23.730857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:23.731797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 319/644] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:23.732722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.790288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632f698-65b4-4dad-a2ac-53a63c864de4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.829504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.830689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.831005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.831285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.831957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:23.832263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:23.833687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:23.840142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc1097-d6f8-4125-9147-6c1dff3a9091 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:23.843560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 326/645] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:23.845772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.866344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.885048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:23.885953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:23.886239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:23.886514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:23.887156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:23.887459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:23.888884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:23.905381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 320/646] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:23.905381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:23.927443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:23.968867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766415cf-7194-4bfd-bb9d-d8e5590a92e6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.004460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40048070-0819-460b-915c-243fbb0fdc52 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.004876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.005480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.005759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.006036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.038764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.039291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.039572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.039845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.040531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:24.040833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.042199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.055636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 321/647] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:24.055636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.084970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.086426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.094266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.158288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474acb2-5238-4639-93cf-3b85525fa602 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.158528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.195522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.196177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.196508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.196785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.197465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 327/648] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:24.198187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.213916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.215473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:24.231389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:24.232615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:24.233785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:24.233785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:24.233785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:24.237924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 322/649] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:24.238595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.309208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d3fa-cbb6-4324-ae2c-2d0283d18088 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.329964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.339408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966bf3-5db0-427c-89ca-a36dfa4e2682 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.344224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.344891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.345169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.345440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.352876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.354309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:24.365098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:24.366045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:24.366924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 328/650] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:24.367421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.373498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.374126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.374405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.374688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.386220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.387662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.393109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:24.401930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:24.403041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:24.403943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:24.403943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:24.403943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:24.403943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 323/651] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:24.403943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.470155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa040-c71a-4062-9cdc-3e2fec1c6412 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.500635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383159d-2603-4e69-846b-ea9896a5abe1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.503615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b670f-a638-4a5a-a895-32215088ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.504235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b670f-a638-4a5a-a895-32215088ee46 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.504543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b670f-a638-4a5a-a895-32215088ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.504814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b670f-a638-4a5a-a895-32215088ee46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.514539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b670f-a638-4a5a-a895-32215088ee46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.515993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b670f-a638-4a5a-a895-32215088ee46 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-cf8b670f-a638-4a5a-a895-32215088ee46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:24.530521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:24.531449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:24.533128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:24.533128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:24.533128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:24.533128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 329/652] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:24.533128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0e27-4f3f-4a84-89dc-9f2d613a9d7e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.533128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0e27-4f3f-4a84-89dc-9f2d613a9d7e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.533467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0e27-4f3f-4a84-89dc-9f2d613a9d7e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.537729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 330/653] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:24.537870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.537984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0e27-4f3f-4a84-89dc-9f2d613a9d7e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.538083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.538083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.538083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.538083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:24.538083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.539250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.551391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 324/654] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:24.552182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.556879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.618883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.644075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0e27-4f3f-4a84-89dc-9f2d613a9d7e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.649038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ce687-1291-4819-ac0c-82db66ad1c9b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.676587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.677188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.677471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.677747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.678424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:24.678726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.680155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.681492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d294e58-09d0-4928-b90a-a501bf36f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.682090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d294e58-09d0-4928-b90a-a501bf36f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.682366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d294e58-09d0-4928-b90a-a501bf36f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.682644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d294e58-09d0-4928-b90a-a501bf36f7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.683271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d294e58-09d0-4928-b90a-a501bf36f7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:24.683571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d294e58-09d0-4928-b90a-a501bf36f7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.684938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d294e58-09d0-4928-b90a-a501bf36f7c9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.692438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 331/655] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:24.693221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.700712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 325/656] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:24.702316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3acab7-750f-45c8-a0ff-b0a8b697650a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.702605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3acab7-750f-45c8-a0ff-b0a8b697650a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.703211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3acab7-750f-45c8-a0ff-b0a8b697650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.721440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1a3acab7-750f-45c8-a0ff-b0a8b697650a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:24.722587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1a3acab7-750f-45c8-a0ff-b0a8b697650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:24.780168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.788398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 326/657] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:24.789180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3acab7-750f-45c8-a0ff-b0a8b697650a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.789314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d106479-de57-4552-be21-33da7878f5fc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.831927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.833351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.833885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.834326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.835153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:24.835625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.837333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.844195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:24.857044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 332/658] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:24.858001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.896188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3acab7-750f-45c8-a0ff-b0a8b697650a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:24.930682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:24.931312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:24.931592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:24.931866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:24.938952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:24.940961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:24.952318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:24.953269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 327/659] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:24.954209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:24.971697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79fef6-ba61-4294-8e70-1e4dfe1c4e57 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.009083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.014377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.015451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.016004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.016493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.017443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=6d280ee7087f43a3a7e4c4940a8f23af) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:25.017920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.020064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.036322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 333/660] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/role_assignments?user.id=6d280ee7087f43a3a7e4c4940a8f23af&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:25.036322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.074129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2242b8-2190-4630-b968-32f4cf01ff0c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.112837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.116009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.116766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.117090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.117316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.125901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.127401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:25.140879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:25.141919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 328/661] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:25.142852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.161032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96db716-95ff-4aea-be33-21003fd1323b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.201350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.202506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.203287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.203640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.211973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.213340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:25.226404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:25.227424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 334/662] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:25.228657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.269803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abbf1f-ee19-4755-9bd9-e56d62c80bca None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.285038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.308230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.308786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.309063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.309368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.310053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:25.310357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.311781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.329677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 329/663] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:25.330496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.355795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b97d-9315-4a8f-85bc-a356d3b763c1 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.381203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.393924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.394763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.395193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.395467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.406287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:25.413221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:25.414205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:25.415046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 335/664] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:25.415787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.441492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295526c-8e8e-40fd-b58a-75aa82534c0b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.477287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.477800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.478075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.478362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.479057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:25.479358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.480812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.499165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 330/665] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:25.499889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.530390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.534019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b8757-1490-4948-930a-4e5b3e93dd86 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.570494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.571100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.571376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.571643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.572347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:25.572652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.574068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.591285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 336/666] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:25.591285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.608794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d680c8-49b8-467a-a191-097c5edcb540 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.634190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.643159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.643823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.644105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.644407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.698204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496325-7d76-4aa2-a143-12b8082bc9f8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.712523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.713989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.732732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.733340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.733618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.733888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.734544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:25.734842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.736185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.743029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.750752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 337/667] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:25.750752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.825968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 331/668] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:25.827163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:25.872672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318c983-3257-4da8-9a99-559cddd67000 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.876167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.912603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.913211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.913545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.913821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.941788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62016cc7-00e6-4e2e-bb0a-53fd7be26d89 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:25.973659 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:25.980991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:25.981601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:25.981882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:25.982159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:25.982892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=c83d5e7a41404bacb2b4d18daf040aa0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:25.983200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.984308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:25.984722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.986278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:25.991258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 332/669] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/role_assignments?user.id=c83d5e7a41404bacb2b4d18daf040aa0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:25.992118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.113422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867adf71-1b2e-49b4-b8a2-37a204abc0b3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.145293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 338/670] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:26.146051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.150558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:26.158226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.159865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.160383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.160918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.173663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.174966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:26.195967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:26.196993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:26.197887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:26.197887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:26.197887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:26.200214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 333/671] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:26.201272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.260617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:26.284395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f531-f389-4233-b2e7-38208f4a48df None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.322996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.323657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.323940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.324213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.335536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.336882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.339697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be4ed0-7240-4c85-9571-0c8a96675184 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:26.352711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:26.353766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:26.354724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:26.354724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:26.354724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:26.354724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 339/672] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:26.355480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.389836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.391322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.391756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.392202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.408501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.409990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.424320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:26.426353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:26.427293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:26.428212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:26.428212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:26.428212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:26.428212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 334/673] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:26.429158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.502706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5d3f3-8f89-4aaf-97b6-6aa2e6fa12a6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.539554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:26.542553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede39e3f-e2b0-4f7f-8919-cf5930e7bb30 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.552355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.553623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.554058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.554525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.555904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:26.556555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.558503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.576896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 340/674] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:26.578199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.585903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.586636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.587015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.587387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.588129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:26.588847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.590099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.603343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 335/675] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:26.604387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.695174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787883a-b53e-4c64-9493-5d464bf0d75c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.712793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:26.738024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.739278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.739980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.740431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.741477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:26.742362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.744195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.745101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147c5f5-efa0-4da8-89e2-a23df0ab32c6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.763979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 341/676] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:26.765380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.785553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.786359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.786472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.786725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.794464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.795852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:26.808370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:26.809344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 336/677] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:26.810290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.840130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:26.904344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8becb-a840-437b-93d0-24fb80c7cdb3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.940126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.940912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.941195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.941470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.943582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d66a42-d3ec-42db-853b-9a2d05305fec None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:26.948512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.949969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:26.961567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:26.962492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:26.963419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 342/678] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:26.963912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:26.987052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:26.988299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:26.988588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:26.988862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:26.996952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:26.999254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.009900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:27.014030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:27.015514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 337/679] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:27.017181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:27.104993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121b7a-970b-4329-8004-16817cd0177a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:27.118374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:27.147778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8463721-60e4-4c14-a811-180ca81a34ca None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:27.163051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:27.164032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.164771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.165288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.166894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:27.167745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:27.169604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.197073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:27.197734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.197974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.198362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.198678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 343/680] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 21 05:15:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:27.199738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:27.203971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:27.204309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:27.206825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.223147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 338/681] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:27.224025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:27.327424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:27.334322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe807b-5909-4801-a24a-d387f43f4755 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:27.346335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e50b80-b496-4bd6-9eae-4b1e642f1967 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:27.370539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:27.371354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.371796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.372070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.373049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:27.373359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:27.374793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.382759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56f921-02f0-4fc5-b410-405c8ab5b66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:27.383797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f921-02f0-4fc5-b410-405c8ab5b66f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.384248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f921-02f0-4fc5-b410-405c8ab5b66f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.384540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f921-02f0-4fc5-b410-405c8ab5b66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.391714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 344/682] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:27.391714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:27.399376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:27.467866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56f921-02f0-4fc5-b410-405c8ab5b66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:27.471037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56f921-02f0-4fc5-b410-405c8ab5b66f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.498747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ce258-fbcb-434e-aeab-f7ed0c68204d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:27.531794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efc8c3-fbf8-4c87-bc83-a3b4d66c345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:27.532432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc8c3-fbf8-4c87-bc83-a3b4d66c345a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.532715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc8c3-fbf8-4c87-bc83-a3b4d66c345a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.532989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc8c3-fbf8-4c87-bc83-a3b4d66c345a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.533705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efc8c3-fbf8-4c87-bc83-a3b4d66c345a None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=f354351c3e9d41d09ea2610b47cefa0c) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:27.534074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efc8c3-fbf8-4c87-bc83-a3b4d66c345a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:27.535995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efc8c3-fbf8-4c87-bc83-a3b4d66c345a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.541931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 345/683] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:27 2022] GET /identity/v3/role_assignments?user.id=f354351c3e9d41d09ea2610b47cefa0c&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:27.543066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403436b-b8c2-428c-9b2a-ee7b398ea5aa None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.543349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403436b-b8c2-428c-9b2a-ee7b398ea5aa None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.543625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403436b-b8c2-428c-9b2a-ee7b398ea5aa None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.544826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 346/684] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:27.548473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403436b-b8c2-428c-9b2a-ee7b398ea5aa None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:27.573957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:27.603376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 339/685] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:27.605114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f078-2936-4ac4-bb91-1e19ad69f70b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.605581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f078-2936-4ac4-bb91-1e19ad69f70b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.606061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f078-2936-4ac4-bb91-1e19ad69f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.626297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-60c6f078-2936-4ac4-bb91-1e19ad69f70b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:27.628465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-60c6f078-2936-4ac4-bb91-1e19ad69f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:27.664670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:27.699885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403436b-b8c2-428c-9b2a-ee7b398ea5aa None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:27.707910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 340/686] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:27.711140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f078-2936-4ac4-bb91-1e19ad69f70b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:27.766018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:27.766932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.767418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.767695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.768565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=0d585fa74ead490abff52d8b03f850fa) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:27.768884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:27.770328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.780783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 347/687] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:27 2022] GET /identity/v3/role_assignments?user.id=0d585fa74ead490abff52d8b03f850fa&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:27.844618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f078-2936-4ac4-bb91-1e19ad69f70b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:27.885899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:27.886892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:27.887408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:27.887897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:27.900777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:27.902610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:27.920175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:27.921256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:27.922144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:27.922144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:27.922144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:27.924350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 341/688] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:27.930244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:28.023032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:28.027969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:28.046709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca80ae-724f-49ea-a007-9ddf8d34e2de None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:28.059259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:28.091768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:28.092687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.092973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.093249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.093905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:28.094469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:28.096304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:28.112260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 348/689] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:28.117486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:28.156844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22512d98-019b-4799-86bd-31b04ae0275e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:28.197502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:28.199083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.199822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.200341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.216975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:28.218885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:28.239931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:28.240975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:28.241869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:28.241869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:28.241869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:28.244353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 342/690] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:28.252288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:28.268628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a38d-3a09-4a2d-ad24-c7900440331a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:28.339479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:28.340132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.340433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.340707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.351309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:28.352790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:28.377446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:28.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:28.379921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:28.380370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 349/691] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:28.385448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:28.390165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:28.394905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:28.443112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef58a1c-3644-47f5-948a-e542755fd33a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:28.486271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac04178-14df-4b51-bfb7-75c8b22af200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:28.487040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04178-14df-4b51-bfb7-75c8b22af200 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.488238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04178-14df-4b51-bfb7-75c8b22af200 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.488553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04178-14df-4b51-bfb7-75c8b22af200 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.489487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04178-14df-4b51-bfb7-75c8b22af200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:28.489796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04178-14df-4b51-bfb7-75c8b22af200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:28.491633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04178-14df-4b51-bfb7-75c8b22af200 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:28.508632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725686a2-6fe3-4424-8a1a-755c82344c4d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:28.509194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 343/692] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:28.510631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a45d2a-dd0f-42d1-9822-cc765680adc4 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.511022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a45d2a-dd0f-42d1-9822-cc765680adc4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.511301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a45d2a-dd0f-42d1-9822-cc765680adc4 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.512595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 344/693] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:28.513675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a45d2a-dd0f-42d1-9822-cc765680adc4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:28.548557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a800e0-dbd0-4f90-8018-652afca81f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:28.549166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a800e0-dbd0-4f90-8018-652afca81f45 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.549442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a800e0-dbd0-4f90-8018-652afca81f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.550375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a800e0-dbd0-4f90-8018-652afca81f45 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.551063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a800e0-dbd0-4f90-8018-652afca81f45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:28.551366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a800e0-dbd0-4f90-8018-652afca81f45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:28.552834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a800e0-dbd0-4f90-8018-652afca81f45 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:28.567141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 350/694] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:28.568557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706b619-52b1-4a73-8f93-a8ba246378c1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.568888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706b619-52b1-4a73-8f93-a8ba246378c1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.569163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706b619-52b1-4a73-8f93-a8ba246378c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.590159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-9706b619-52b1-4a73-8f93-a8ba246378c1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:28.591329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9706b619-52b1-4a73-8f93-a8ba246378c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:28.650828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a45d2a-dd0f-42d1-9822-cc765680adc4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:28.655122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:28.672339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 351/695] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:28.672339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706b619-52b1-4a73-8f93-a8ba246378c1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:28.719186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:28.721077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:28.722463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.723211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.723446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.725009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:28.727331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:28.780492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 345/696] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:15:28 2022] POST /identity/v3/users => generated 254 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:15:28.871265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706b619-52b1-4a73-8f93-a8ba246378c1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:28.917521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:28.918132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:28.918409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:28.918684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:28.919419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=1bc038af597c45648f6603d2ef6d685c) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:28.919729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:28.921237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:28.929514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 352/697] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:28 2022] GET /identity/v3/role_assignments?user.id=1bc038af597c45648f6603d2ef6d685c&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:28.991790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:29.131936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df214359-0d74-448f-885b-203f2fad26e8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:29.171311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:29.171960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:29.172238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:29.172541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:29.185826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:29.191517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:29.192477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:29.193329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 346/698] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:29.200489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:29.275837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:29.324001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949b9d-e326-4666-bb48-a97b878b1c6e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:29.364509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:29.365535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:29.366022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:29.366500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:29.367370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:29.367878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:29.369492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:29.379282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 353/699] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:29.385068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:29.451244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:29.507977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c515e-552d-4930-b2b9-6891faf5d3df None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:29.550656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:29.551222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:29.551502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:29.551774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:29.564838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:29.566906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:29.587246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:29.588237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:29.589199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:29.589199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:29.589199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:29.592800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 347/700] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:29.594043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:29.745167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d179-6e86-4da0-ad26-1a8443d5b780 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:29.773144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:29.793532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:29.794140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:29.794414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:29.794721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:29.795317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:29.795613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:29.797000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:29.810464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 354/701] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:29.816731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:29.994668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:29.998141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557b038-7fda-49fc-bdbe-9173148d1ab2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:30.039264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:30.039898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.040179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.040459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.048719 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:30.050199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:30.062178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:30.063984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:30.066540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 348/702] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:15:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:30.072345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:30.223254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c1c4d-a8df-46ac-804e-689402bd1100 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:30.270855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b825d-13e9-4029-b472-13da3982606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:30.271471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b825d-13e9-4029-b472-13da3982606a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.271752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b825d-13e9-4029-b472-13da3982606a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.272020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b825d-13e9-4029-b472-13da3982606a None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.272783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b825d-13e9-4029-b472-13da3982606a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:30.273091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b825d-13e9-4029-b472-13da3982606a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:30.274529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b825d-13e9-4029-b472-13da3982606a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:30.303237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 355/703] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:15:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:30.311216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:30.325938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd23e-8427-448b-96bf-906949ee07a4 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.326145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd23e-8427-448b-96bf-906949ee07a4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.326441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd23e-8427-448b-96bf-906949ee07a4 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.327950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 356/704] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:30.332923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44e41-5d02-442f-83f0-fd3b5a9f4929 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.333209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44e41-5d02-442f-83f0-fd3b5a9f4929 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.333488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44e41-5d02-442f-83f0-fd3b5a9f4929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.365439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-aca44e41-5d02-442f-83f0-fd3b5a9f4929 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:30.366687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-aca44e41-5d02-442f-83f0-fd3b5a9f4929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:30.419226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:30.474056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a2468-a428-47da-bfbc-cd47d3f45a56 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:30.488850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 357/705] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:15:30.520703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:30.521306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.521573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.521844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.564221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:30.621310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:30.623031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:30.684114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957bddc-7d50-4508-bae1-91715f24b7ee None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.684553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957bddc-7d50-4508-bae1-91715f24b7ee None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.684743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957bddc-7d50-4508-bae1-91715f24b7ee None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.686245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 358/706] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:30.691800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436874b-bd9a-4a66-b0fe-0eebda06ab0a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.692099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436874b-bd9a-4a66-b0fe-0eebda06ab0a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.692391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436874b-bd9a-4a66-b0fe-0eebda06ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.711960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-f436874b-bd9a-4a66-b0fe-0eebda06ab0a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:30.713381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f436874b-bd9a-4a66-b0fe-0eebda06ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:30.767402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 349/707] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:30.773415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:30.799914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 359/708] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 05:15:30.872332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:30.940312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22227253-1c66-4370-a709-8e4dc4b77e03 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:30.978759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:30.979389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:30.979670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:30.979945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:30.990582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:30.992026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:31.007229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:31.011219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:31.014573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:31.014573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:31.014573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:31.014573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 350/709] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:31.015423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436874b-bd9a-4a66-b0fe-0eebda06ab0a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.109958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.184874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:31.188731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436874b-bd9a-4a66-b0fe-0eebda06ab0a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.266869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f59f1e-9968-4631-acae-11c920d8aab7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.291456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.292609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:31.292998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.293467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.293945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.294860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:31.295369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.297453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.311903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 360/710] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:31.317326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.318156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.318796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.319076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.319348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] PATH_INFO: `/v3/services/network` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.319939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.321632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:31.336940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:31.337994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:31.338844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 351/711] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:31.339650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.446896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc6da-2c5f-40dd-9900-07e84aebb778 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.469799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a3989-a2f4-4811-a401-cf3daac8b357 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.488360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.489421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.489708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.489985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.490838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.492200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:31.506868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:31.507851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:31.508698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:31.512409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 361/712] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:31.513248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.514326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.515202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.516020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.516894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.527007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.528838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:31.540511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:31.541386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:31.542288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:31.542701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:31.549167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 352/713] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:31.550771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.589106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:31.640033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03bf4-b832-4aa8-86e3-f36e2095ceae None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.657986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dd7d0-7311-4f88-8187-933fa407c08b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.679701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.680328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.680615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.680892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.681519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] RBAC: Adding query filter params (name=network) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:31.681824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.683468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.689389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 362/714] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:31.691228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.702151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.702711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.702991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.703262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.703981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:31.704306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.705759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.712661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 353/715] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:31.713885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.800139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:31.820160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd460cc-156d-4d09-9fd1-8f444b15deca None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.833093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:31.837689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac558bc-ab1a-4daa-8746-5524a688f98e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:31.863842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.864580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.864862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.865139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.865834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:31.866141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.867568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.885806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 363/716] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:31.885806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:31.888992 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:31.890444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:31.890444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:31.890444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:31.891114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] RBAC: Adding query filter params (type=network) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:31.891516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:31.893039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:31.904435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 354/717] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:31.905566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:32.002491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3976a-5413-4681-8e5b-b13839d7c288 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:32.041632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0eb24-0681-45b7-966d-a4fd32f50be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:32.042255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0eb24-0681-45b7-966d-a4fd32f50be0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:32.042592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0eb24-0681-45b7-966d-a4fd32f50be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:32.042870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0eb24-0681-45b7-966d-a4fd32f50be0 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:32.043510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0eb24-0681-45b7-966d-a4fd32f50be0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:32.043859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0eb24-0681-45b7-966d-a4fd32f50be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:32.051847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0eb24-0681-45b7-966d-a4fd32f50be0 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:32.064120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 364/718] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:32.098804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7e2b-3a85-45c5-9234-a1142a3df44b None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:32.099134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7e2b-3a85-45c5-9234-a1142a3df44b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:32.099356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7e2b-3a85-45c5-9234-a1142a3df44b None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:32.105297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 365/719] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:32.107322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6348a-825c-4cf7-9311-fbdc94966a10 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:32.107616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6348a-825c-4cf7-9311-fbdc94966a10 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:32.107887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6348a-825c-4cf7-9311-fbdc94966a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:32.124005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29f34f-c9f7-43a2-a995-8c7ed64d961a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:32.134336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d3f6348a-825c-4cf7-9311-fbdc94966a10 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:32.135993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d3f6348a-825c-4cf7-9311-fbdc94966a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:32.138949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:32.193292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ba49f-19b5-49d2-a933-ffe1075e33fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:32.193865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba49f-19b5-49d2-a933-ffe1075e33fc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:32.194143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba49f-19b5-49d2-a933-ffe1075e33fc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:32.194415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba49f-19b5-49d2-a933-ffe1075e33fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:32.195587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ba49f-19b5-49d2-a933-ffe1075e33fc None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=c83d5e7a41404bacb2b4d18daf040aa0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:32.195587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ba49f-19b5-49d2-a933-ffe1075e33fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:32.197231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ba49f-19b5-49d2-a933-ffe1075e33fc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:32.204087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 355/720] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:31 2022] GET /identity/v3/role_assignments?user.id=c83d5e7a41404bacb2b4d18daf040aa0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:32.220182 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 366/721] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:32.401540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451fa1c-1ee4-47af-a66c-05a7d01c1cd9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:32.401816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451fa1c-1ee4-47af-a66c-05a7d01c1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:32.402159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451fa1c-1ee4-47af-a66c-05a7d01c1cd9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:32.403781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 356/722] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:32.409527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc14001-bdb8-4745-8a5e-d3f2c321b45b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:32.410383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc14001-bdb8-4745-8a5e-d3f2c321b45b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:32.410857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc14001-bdb8-4745-8a5e-d3f2c321b45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:32.439932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5fc14001-bdb8-4745-8a5e-d3f2c321b45b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:32.441513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5fc14001-bdb8-4745-8a5e-d3f2c321b45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:32.535421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 367/723] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:32.556888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451fa1c-1ee4-47af-a66c-05a7d01c1cd9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:32.601211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:32.701607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451fa1c-1ee4-47af-a66c-05a7d01c1cd9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:32.742218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:32.743215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:32.743697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:32.744169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:32.761101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:32.766358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:32.767278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:32.770500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 357/724] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:32.776443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc14001-bdb8-4745-8a5e-d3f2c321b45b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:32.898838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:32.901546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:32.939678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc14001-bdb8-4745-8a5e-d3f2c321b45b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.019842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.020435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.020723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.020997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.021679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:33.021983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:33.023376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:33.038308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 368/725] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:33.043485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:33.043901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:33.063368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42a15-4f82-41b5-9b19-e480d3ba5ffa None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.121388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.123170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.123455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.123728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.135426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:33.141736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:33.142729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:33.143630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 358/726] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:33.149149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:33.231345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf6d9a-bd1c-45b9-a89c-f2cc2235ac9e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.281221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:33.292892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.293586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.293866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.294141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.312181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9e7cd-28f8-41b9-89e1-26008ea2055b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.321307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:33.322771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:33.351530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:33.352533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:33.353426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:33.353426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:33.353426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:33.353426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 369/727] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:33.359375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:33.368796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.369462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.369743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.370015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.370669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:33.370971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:33.375540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:33.393611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 359/728] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:33.398976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:33.423912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:33.558720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d416a39-aa62-4131-b9ea-9ab22e4d33a9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.573819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643ccd-b4cb-4648-ae8b-cd5e621afb02 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.599516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.600131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.600445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.600723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.601370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:33.601675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:33.603057 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:33.618688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 370/729] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:33.622849 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.623483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.623860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.624994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:33.625409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.649402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:33.650869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:33.675804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:33.678045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:33.680124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:33.680124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:33.680124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:33.680124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 360/730] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:33.685719 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:33.703204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:33.797303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9565c-7bf2-410c-8596-7d2790a39736 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.816678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:33.858510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.858866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.859148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.859421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.868635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:33.870071 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:33.882925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192420-065f-4fdd-afe3-ac6af5819875 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:33.894350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:33.895311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:33.896245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 371/731] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:33.903904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:33.947401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:33.948011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:33.948301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:33.948590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:33.949224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:33.949524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:33.950887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:33.978489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 361/732] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:33.985096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:34.103540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0057af-d12a-4f06-b5eb-998e99e18be4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:34.105138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:34.110411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c21091-67b2-4055-a626-48c17c336aae None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:34.139640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:34.140254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.140556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.140831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.141561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:34.141869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:34.143353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:34.156796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:34.161280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 372/733] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:34.166713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:34.183844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:34.184523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.184794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.185069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.200209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:34.201701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:34.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:34.228506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:34.229439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 362/734] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:34.234523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:34.376622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7447a3d-705d-4a5f-8456-22a7eaf564b3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:34.421556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c559ba5-ce12-4e12-8a5b-7c25db789b69 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:34.442915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f6147-e378-4f8d-9c9d-c8971e384259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:34.443542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f6147-e378-4f8d-9c9d-c8971e384259 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.443822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f6147-e378-4f8d-9c9d-c8971e384259 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.444097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f6147-e378-4f8d-9c9d-c8971e384259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.496219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb23e-9d8b-4b32-9924-ff6727233f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:34.496862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb23e-9d8b-4b32-9924-ff6727233f49 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.497142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb23e-9d8b-4b32-9924-ff6727233f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.497666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb23e-9d8b-4b32-9924-ff6727233f49 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.500797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb23e-9d8b-4b32-9924-ff6727233f49 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:34.501110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb23e-9d8b-4b32-9924-ff6727233f49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:34.504655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:34.504921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb23e-9d8b-4b32-9924-ff6727233f49 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:34.548101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 363/735] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 21 05:15:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:34.558930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4b3fa-8994-4ac9-abf7-af69d80736c0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.559217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4b3fa-8994-4ac9-abf7-af69d80736c0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.559497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4b3fa-8994-4ac9-abf7-af69d80736c0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.561297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 364/736] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:34.565863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4b3fa-8994-4ac9-abf7-af69d80736c0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:34.576474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f6147-e378-4f8d-9c9d-c8971e384259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:34.578592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f6147-e378-4f8d-9c9d-c8971e384259 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:34.637482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:34.691540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 373/737] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:34.692821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b0db2-ac3f-42be-9fc3-5a98b6b642d5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.693106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b0db2-ac3f-42be-9fc3-5a98b6b642d5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.693377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b0db2-ac3f-42be-9fc3-5a98b6b642d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.700691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4b3fa-8994-4ac9-abf7-af69d80736c0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:34.712948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-f38b0db2-ac3f-42be-9fc3-5a98b6b642d5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:34.714293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f38b0db2-ac3f-42be-9fc3-5a98b6b642d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:34.735702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03871110-2c0c-44cf-b029-cf831649d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:34.736006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871110-2c0c-44cf-b029-cf831649d83c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.736262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871110-2c0c-44cf-b029-cf831649d83c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.736562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871110-2c0c-44cf-b029-cf831649d83c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.774032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:34.786990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 374/738] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:34.788321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6c262-9b03-487a-90ef-fb6830e39fbb None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.788613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6c262-9b03-487a-90ef-fb6830e39fbb None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.788889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6c262-9b03-487a-90ef-fb6830e39fbb None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.790111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 375/739] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:34.790801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6c262-9b03-487a-90ef-fb6830e39fbb None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:34.812512 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03871110-2c0c-44cf-b029-cf831649d83c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:34.814774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03871110-2c0c-44cf-b029-cf831649d83c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:34.864984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:34.908294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6c262-9b03-487a-90ef-fb6830e39fbb None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:34.931032 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 365/740] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 05:15:34.932374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e9e7-2ca6-4ba7-8753-17b9214f4910 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.932660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e9e7-2ca6-4ba7-8753-17b9214f4910 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.932935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e9e7-2ca6-4ba7-8753-17b9214f4910 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.934423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 366/741] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:34.935589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156734-3393-4cab-b157-cf01d4e77b46 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.935868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156734-3393-4cab-b157-cf01d4e77b46 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.936136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156734-3393-4cab-b157-cf01d4e77b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.945758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:34.946394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:34.946674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:34.946946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:34.953437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0f156734-3393-4cab-b157-cf01d4e77b46 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:34.954605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0f156734-3393-4cab-b157-cf01d4e77b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:34.958304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:34.959741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:34.975188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:34.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:34.977031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:34.977031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:34.977031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:34.977031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 376/742] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:34.977617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.025616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:35.029784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 367/743] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:35.031117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53336-c153-48f8-b4c4-c2aad46a78e2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.031405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53336-c153-48f8-b4c4-c2aad46a78e2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.031674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53336-c153-48f8-b4c4-c2aad46a78e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.051627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b1d53336-c153-48f8-b4c4-c2aad46a78e2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:35.052599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b1d53336-c153-48f8-b4c4-c2aad46a78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:35.099022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bfd1e-a703-40f0-8456-609e26de4959 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.121554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:35.128319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 368/744] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 05:15:35.128319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53336-c153-48f8-b4c4-c2aad46a78e2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.145262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.146090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.146623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.147071 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.162892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.164570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:35.179978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:35.181147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:35.182273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:35.182273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:35.182273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:35.183991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 377/745] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:35.185072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.262616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53336-c153-48f8-b4c4-c2aad46a78e2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.294311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:35.303353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94b57-9282-4beb-b413-5b0fc28c47a2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.304720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.305524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.305967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.306431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.307263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:35.307741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.309374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.321831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 369/746] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:35.322873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.342969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.343892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.344411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.344869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.345689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.347808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.365952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 378/747] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:15:35 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:35.366980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.401631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:35.449131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bc25-7fb7-4370-8135-1ff23d7a7245 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.491826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.492488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.492765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.493040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.493703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:35.494003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.495421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.500976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fee0b2-1a43-4202-8c88-80bbdf5495e7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.513154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 370/748] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:35.513154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.546077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.547047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.547047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.547301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.550253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.550253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.566066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 379/749] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:15:35 2022] POST /identity/v3/services => generated 240 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:35.567359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.581212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:35.648470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19bad2-65d5-44f2-8562-c1c039ea3a30 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.674979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:35.710223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.710422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d875-8520-4673-92d1-6a224afaa6d9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.711209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.711633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.712049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.723183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.725812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:35.743255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:35.744409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:35.745490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:35.749010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 371/750] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:35.749983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.757387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.758287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.758569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.758842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.770443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:35.776627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:35.777609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:35.778464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:35.779115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 380/751] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:35.779673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.865987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:35.885226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682cd44-b7ce-4cea-944a-28bcf855ef0e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.914187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1724b8-8a7e-44a3-bd49-a20f023a3f65 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:35.925326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.926019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.926301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.926575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.933970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.935415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:35.946880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:35.947798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:35.948746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 372/752] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:35.950463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.955878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:35.956532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:35.956809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:35.957084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:35.957786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:35.958087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:35.960085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:35.976656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 381/753] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:35.977484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:35.983091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:36.064109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620bed2-9b2d-4355-aea3-e18fa08ffbe4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.101524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:36.102536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:36.102996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:36.103443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:36.104433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:36.104945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:36.106549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:36.108129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead000-d0cb-4469-9716-1f9090b4efb3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.116849 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 373/754] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:36.118155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:36.141284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:36.153739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:36.154364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:36.154640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:36.154910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:36.155757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:36.156072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:36.158134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:36.178168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 382/755] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:36.178168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:36.229350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:36.238502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b47200-489a-42b3-a6c8-63568b1a998b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.275658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:36.277214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:36.277698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:36.278171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:36.279116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=8c4901865c4748b7855435c801e37ea0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:36.279796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:36.281602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:36.296909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 374/756] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:36 2022] GET /identity/v3/role_assignments?user.id=8c4901865c4748b7855435c801e37ea0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:36.298270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:36.300844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9237a2-f5e5-4b56-aae5-d3b5f28099d2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.352496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:36.353871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:36.355356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:36.356667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:36.382595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:36.384060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:36.411239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:36.412268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:36.413219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:36.413219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:36.413219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:36.420295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 383/757] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:36.422766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:36.475526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:36.520227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f8f98-2b1f-4c90-ba8b-d4db60ebecdf None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.553726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851457-5ad9-4368-95fa-05f170592b46 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.574807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:36.575416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:36.575690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:36.575957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:36.576709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=1bc038af597c45648f6603d2ef6d685c) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:36.577014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:36.578439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:36.593364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 375/758] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:36 2022] GET /identity/v3/role_assignments?user.id=1bc038af597c45648f6603d2ef6d685c&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:36.617191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:36.617896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:36.618111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:36.618386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:36.619046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:36.619345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:36.620783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:36.634299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 384/759] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:36.639572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:36.671541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:36.766317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67191e85-3ddb-46bd-a9f2-eab26b528372 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.807965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:36.808567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:36.808844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:36.809114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:36.821022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:36.822476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:36.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:36.847521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:36.848490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 376/760] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:15:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:36.853549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:36.969516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8b04e-adfb-48b2-8972-aeef77d225ab None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:36.972574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:37.005551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:37.006163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:37.006445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:37.006721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:37.007489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:37.007804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:37.009274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:37.032634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 385/761] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:15:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:37.034200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:37.148242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:37.167100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3b81-9c74-4a9f-b34b-283051bf424b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:37.233977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:37.234637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:37.234913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:37.235184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:37.262329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:37.263809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:37.284262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:37.286126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:37.287557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:37.287557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:37.287557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:37.291245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 377/762] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:37.293080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:37.448390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535b418-2fce-4bb7-aae5-eb47ef28c2bc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:37.482980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:37.483605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:37.483882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:37.484154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:37.484838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:37.485143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:37.492299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:37.510854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 386/763] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:37.511852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:37.714309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d0bae-64d5-4277-90f7-7b7426709dc2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:37.765025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d4003-23be-421d-acfb-2dc3f7a9c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:37.765699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4003-23be-421d-acfb-2dc3f7a9c41f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:37.765982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4003-23be-421d-acfb-2dc3f7a9c41f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:37.766258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4003-23be-421d-acfb-2dc3f7a9c41f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:37.769333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:37.778508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d4003-23be-421d-acfb-2dc3f7a9c41f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:37.780017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d4003-23be-421d-acfb-2dc3f7a9c41f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-440d4003-23be-421d-acfb-2dc3f7a9c41f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:37.803854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:37.804840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:37.805734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 378/764] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:37.813637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:37.844664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:37.986431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ca3df-3298-47ba-9930-d1664c728d83 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:38.031053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6d1e-2b9a-4d10-bdb6-074f9d4fd8c9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:38.031362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6d1e-2b9a-4d10-bdb6-074f9d4fd8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:38.031597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6d1e-2b9a-4d10-bdb6-074f9d4fd8c9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:38.033356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:38.034652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:38.034921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:38.035198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:38.035960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:38.036265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:38.037719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:38.037983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 379/765] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:38.040305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692752e-071d-4b47-8862-20a2171fd2f4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:38.041067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692752e-071d-4b47-8862-20a2171fd2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:38.042158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692752e-071d-4b47-8862-20a2171fd2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:38.075681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 387/766] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:38.079678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:38.083605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6692752e-071d-4b47-8862-20a2171fd2f4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:38.084919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6692752e-071d-4b47-8862-20a2171fd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:38.253372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 380/767] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:38.279836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:38.338552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa47a96-602e-42cc-a5ba-42666fa0ccc5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:38.394610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:38.395281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:38.395552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:38.395822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/c83d5e7a41404bacb2b4d18daf040aa0/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:38.397784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=c83d5e7a41404bacb2b4d18daf040aa0, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:38.399214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:38.410469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa8069-b7ed-413c-8ddb-d995015f3bce None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:38.411025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa8069-b7ed-413c-8ddb-d995015f3bce None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:38.411103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa8069-b7ed-413c-8ddb-d995015f3bce None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:38.412664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 381/768] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:38.420242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e1be-9845-4e6d-88ba-2252de842874 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:38.420549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e1be-9845-4e6d-88ba-2252de842874 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:38.420828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e1be-9845-4e6d-88ba-2252de842874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:38.424624 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 388/769] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:38 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/c83d5e7a41404bacb2b4d18daf040aa0/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:15:38.457444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a8e5e1be-9845-4e6d-88ba-2252de842874 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:38.458686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a8e5e1be-9845-4e6d-88ba-2252de842874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:38.579061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 382/770] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:38.620792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:38.731702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415c1b4-7008-47ca-9d34-408b935db73f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:38.770483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:38.771142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:38.771421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:38.771693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:38.772396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:38.773994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:38.777302 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:38.785233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:38.786325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:38.787167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 389/771] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 21 05:15:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:38.795003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5e1be-9845-4e6d-88ba-2252de842874 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:38.904112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:38.917735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:38.965550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5e1be-9845-4e6d-88ba-2252de842874 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.002933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd240c-18bd-41ab-9637-b90977591e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.003552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd240c-18bd-41ab-9637-b90977591e0d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.003834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd240c-18bd-41ab-9637-b90977591e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.004111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd240c-18bd-41ab-9637-b90977591e0d None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.004806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd240c-18bd-41ab-9637-b90977591e0d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:39.005112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd240c-18bd-41ab-9637-b90977591e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:39.006489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd240c-18bd-41ab-9637-b90977591e0d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:39.011428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 383/772] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 05:15:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:39.012751 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078da06-aefd-41e6-902b-f54c28e8794d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.013043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078da06-aefd-41e6-902b-f54c28e8794d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.013317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078da06-aefd-41e6-902b-f54c28e8794d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.014757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 384/773] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:39.019781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078da06-aefd-41e6-902b-f54c28e8794d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.045262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73538b-dfed-43d0-b683-686a1d566d74 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.082213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7043ad8-e62a-41fb-af03-b9520dfa7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.082852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043ad8-e62a-41fb-af03-b9520dfa7845 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.083178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043ad8-e62a-41fb-af03-b9520dfa7845 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.083455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043ad8-e62a-41fb-af03-b9520dfa7845 None admin] PATH_INFO: `/v3/services/network` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.084096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7043ad8-e62a-41fb-af03-b9520dfa7845 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:39.085570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7043ad8-e62a-41fb-af03-b9520dfa7845 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-a7043ad8-e62a-41fb-af03-b9520dfa7845 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:39.094855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:39.095865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:39.097312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 390/774] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:38 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:39.098604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071b3d-67a0-4a7e-86c1-80ee5711ff30 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.098604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071b3d-67a0-4a7e-86c1-80ee5711ff30 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.103117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071b3d-67a0-4a7e-86c1-80ee5711ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.122966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-2c071b3d-67a0-4a7e-86c1-80ee5711ff30 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:39.124084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2c071b3d-67a0-4a7e-86c1-80ee5711ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:39.144368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078da06-aefd-41e6-902b-f54c28e8794d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.176701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:39.184547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:39.185536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.186212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.186462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.186704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.187333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:39.187639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:39.189071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:39.194452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 385/775] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:39.195311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.199319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 391/776] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:39.205516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c071b3d-67a0-4a7e-86c1-80ee5711ff30 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.328858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c071b3d-67a0-4a7e-86c1-80ee5711ff30 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.371991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.373335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.374809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.375288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.376196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] RBAC: Adding query filter params (interface=public, service_id=bcdee5a70eb5457aa678ec0ec8ab2493, region_id=RegionOne) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:39.376717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:39.378292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:39.387653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 392/777] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/endpoints?service_id=bcdee5a70eb5457aa678ec0ec8ab2493&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:39.393687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.434872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1461bb-4dcd-40d1-81d7-5f9e76e5614d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.487983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57653151-9adf-4725-a667-efbb21e9627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.488619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57653151-9adf-4725-a667-efbb21e9627a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.488900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57653151-9adf-4725-a667-efbb21e9627a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.489174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57653151-9adf-4725-a667-efbb21e9627a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.489800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57653151-9adf-4725-a667-efbb21e9627a None admin] RBAC: Adding query filter params (name=network) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:39.490171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57653151-9adf-4725-a667-efbb21e9627a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:39.491460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57653151-9adf-4725-a667-efbb21e9627a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:39.493978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:39.500349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 386/778] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:39.500349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0452c-d674-4def-8ecb-9eddeb3e0c24 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.500349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0452c-d674-4def-8ecb-9eddeb3e0c24 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.500349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0452c-d674-4def-8ecb-9eddeb3e0c24 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.504251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 387/779] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:39.505792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1288a-9a70-4909-94d0-72739508e69a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.506088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1288a-9a70-4909-94d0-72739508e69a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.506363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1288a-9a70-4909-94d0-72739508e69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.535569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-22e1288a-9a70-4909-94d0-72739508e69a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:39.537621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-22e1288a-9a70-4909-94d0-72739508e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:39.550792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f987b-5936-4b38-b4d5-49a087bcb2e0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.586005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.586608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.586891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.587155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.587479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:39.587740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:39.589134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:39.604332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 393/780] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:39.604332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.644550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 388/781] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:39.645408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1288a-9a70-4909-94d0-72739508e69a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.761794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89a86d-b826-4890-96be-5eab020cf9a9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.803447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:39.818069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.818719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.819003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.819278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.819911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:39.820211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:39.822378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:39.828089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1288a-9a70-4909-94d0-72739508e69a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:39.832531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 394/782] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:39.834490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.870895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:39.871537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:39.871816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:39.872090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:39.887706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:39.892534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:39.894040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:39.895108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 389/783] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:39.900491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:39.950079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:39.957599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64076685-2128-457b-a7c8-55c47e0a18c4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.000809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.001459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.001787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.002060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.003550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] RBAC: Adding query filter params (interface=public, service_id=cacf2b031742496399062d5497baf43a, region_id=RegionOne) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:40.003860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.006215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.016650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 395/784] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/endpoints?service_id=cacf2b031742496399062d5497baf43a&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:40.017260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.041943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e19a1d-895b-4ea4-aef1-979579fce722 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.077447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.078064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.078344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.078618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.079099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:40.079292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:40.079573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.081263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.090944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 390/785] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:40.091766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.145094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d521-8335-4ae1-a928-b0a3830947a2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.182537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.183133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.183442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.183709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.195620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:40.197352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:40.202345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:40.203296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:40.204146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 396/786] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:40.204867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.205975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ab073-f09a-4b06-9a0f-e58fef3e9a29 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.248060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.248744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.249078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.249356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.249967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.251811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.259594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 391/787] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:40.260738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.348356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37a8d-48c4-42eb-86c7-11deb4dc8ed3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.367120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:40.420997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.422012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.422493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.422982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.444839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.447647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.463941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a4e60-2ba8-42a5-ba77-518411377300 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:40.478523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:40.479537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:40.480454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:40.480454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:40.480454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:40.482951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 397/788] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:40.487560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.522099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.522836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.523127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.523519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.524194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:40.524544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.526171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.543013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 392/789] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:40.547594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.585902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:40.648353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17042-d1bf-4385-a8a7-bfd0f5ab96c4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.672910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a8569-1567-48b9-a6c6-573d21ef8711 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.713036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.714004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.714515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.714965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.728952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.731509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.757555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.758177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.758459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.758732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.759386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:40.759697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.761098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:40.767814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:40.768812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:40.769692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:40.769692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:40.769692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:40.769692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 393/790] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:40.780124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.795710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 398/791] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:40.803471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:40.863400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:40.890883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:40.923464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d546ed-c9e8-42cc-bd50-09431925958a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.960754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aa6a1-f43b-4e93-8627-62a004d0ab22 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:40.968538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af01ed9-3e7f-45d6-8d5c-ab2e77bca4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:40.969878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af01ed9-3e7f-45d6-8d5c-ab2e77bca4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.970319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af01ed9-3e7f-45d6-8d5c-ab2e77bca4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.970731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af01ed9-3e7f-45d6-8d5c-ab2e77bca4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.972175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af01ed9-3e7f-45d6-8d5c-ab2e77bca4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:40.972688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af01ed9-3e7f-45d6-8d5c-ab2e77bca4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:40.974202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af01ed9-3e7f-45d6-8d5c-ab2e77bca4a4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:40.987106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 394/792] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:40.988669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870749d1-58e2-49ce-920d-7db707bb589b None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:40.989082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870749d1-58e2-49ce-920d-7db707bb589b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:40.989475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870749d1-58e2-49ce-920d-7db707bb589b None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:40.991328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 395/793] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:40.992350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870749d1-58e2-49ce-920d-7db707bb589b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.006019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f19dee-0433-4103-8d04-e937c80c39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.007030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19dee-0433-4103-8d04-e937c80c39fb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.007473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19dee-0433-4103-8d04-e937c80c39fb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.007886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19dee-0433-4103-8d04-e937c80c39fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.016449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f19dee-0433-4103-8d04-e937c80c39fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.018700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f19dee-0433-4103-8d04-e937c80c39fb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-12f19dee-0433-4103-8d04-e937c80c39fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:41.031385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:41.032379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:41.033305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:41.036493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 399/794] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:41.037942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5262fd8-eb00-4311-befa-1897b57d10ca None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.038383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5262fd8-eb00-4311-befa-1897b57d10ca None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.038807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5262fd8-eb00-4311-befa-1897b57d10ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.058337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d5262fd8-eb00-4311-befa-1897b57d10ca None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:41.059919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d5262fd8-eb00-4311-befa-1897b57d10ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:41.121132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870749d1-58e2-49ce-920d-7db707bb589b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.141510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 400/795] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:41.142681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5262fd8-eb00-4311-befa-1897b57d10ca None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.157672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:41.161092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.161902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.162298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.162692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.166684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:41.172387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.174057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:41.188094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:41.189070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:41.190431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 396/796] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:41.195559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.256129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5262fd8-eb00-4311-befa-1897b57d10ca None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.308056 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.309225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.309702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.310266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.311323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:41.311918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.313618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:41.333122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 401/797] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:41.344138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.369811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070803-0b70-4fe8-bb2f-777001392fed None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.433696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.434319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.434607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.434889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.435628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:41.435944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.438207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:41.477846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 397/798] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:41.484413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:41.485980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.544170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698f61e-1a07-42ee-a7e0-9436b826b8b7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.577790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:41.589914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.591485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.592359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.593323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.608512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.610427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:41.628788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:41.629792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:41.630668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:41.630668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:41.630668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:41.632941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 402/799] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:41.634072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.641608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63156b9f-8bb8-4104-9ebf-13af420c72a7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.680822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.681829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.682303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.682814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.694018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.695759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:41.712166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:41.713168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:41.714081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:41.714081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:41.714081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:41.716238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 398/800] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:41.717404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.754201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f1eb-bf8e-464c-8573-9bd06a23efbd None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.780696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:41.802232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.802911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.803190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.803469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.817691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:41.825599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:41.826523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:41.827352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:41.828488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 403/801] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:41.828565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.851073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50df9-0c88-484b-a11c-df657520741f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.866966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:41.898870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.899805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.900585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.901002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.902020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:41.902495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.904593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:41.921497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 399/802] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:41.923380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:41.951920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006dc77-3971-45d4-8f08-737a5f369d99 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:41.995052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:41.995698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:41.995968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:41.996191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:41.996853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:41.997156 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:41.998793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.015365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 404/803] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:42.016644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.051297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544d05e-d0f2-4efc-a82a-e56e07740be7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.070450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:42.092018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.092660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.092941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.093214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.093861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:42.094165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.095539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.108309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 400/804] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:42.108309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.133842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:42.136631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e22d55-bed9-45de-a5bd-7928f04d8541 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.172193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b29776-ad50-48e7-94f2-13e0ec586885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.172852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b29776-ad50-48e7-94f2-13e0ec586885 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.173450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b29776-ad50-48e7-94f2-13e0ec586885 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.173450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b29776-ad50-48e7-94f2-13e0ec586885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.180650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b29776-ad50-48e7-94f2-13e0ec586885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.182090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b29776-ad50-48e7-94f2-13e0ec586885 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-b8b29776-ad50-48e7-94f2-13e0ec586885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:42.195313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:42.196387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:42.197344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 405/805] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:42.197850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e67f-8d9e-45b2-90b2-7e7311919ddb None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.197850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e67f-8d9e-45b2-90b2-7e7311919ddb None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.197970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e67f-8d9e-45b2-90b2-7e7311919ddb None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.199507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 406/806] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:42.200075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e67f-8d9e-45b2-90b2-7e7311919ddb None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.214889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79b2f6-ca73-4189-917f-377ebecbc5dc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.262094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.262748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.263032 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.263306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.270580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.272043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:42.284309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:42.285238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:42.286114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 401/807] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:42.287000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.319114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e67f-8d9e-45b2-90b2-7e7311919ddb None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.321158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:42.358301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0d1e4-d4f1-40a7-a57c-f67e661c6d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.358928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d1e4-d4f1-40a7-a57c-f67e661c6d9d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.359205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d1e4-d4f1-40a7-a57c-f67e661c6d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.359529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d1e4-d4f1-40a7-a57c-f67e661c6d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.369930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0d1e4-d4f1-40a7-a57c-f67e661c6d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.371411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0d1e4-d4f1-40a7-a57c-f67e661c6d9d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-1fb0d1e4-d4f1-40a7-a57c-f67e661c6d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:42.388127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:42.389298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:42.390738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:42.390738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:42.390738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:42.390738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 407/808] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:42.390972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fab3b-52b1-4eb1-808b-96c9fb390a69 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.391207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fab3b-52b1-4eb1-808b-96c9fb390a69 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.391483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fab3b-52b1-4eb1-808b-96c9fb390a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.412169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-522fab3b-52b1-4eb1-808b-96c9fb390a69 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:42.413484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-522fab3b-52b1-4eb1-808b-96c9fb390a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:42.496313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 408/809] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:42.496313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fab3b-52b1-4eb1-808b-96c9fb390a69 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.502326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:42.520016 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0be1-1246-4552-afdc-c4fb849d1a8a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.557598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.558200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.558475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.558739 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.559451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:42.559752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.561215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.574879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 402/810] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:42.575924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.613829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:42.633643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fab3b-52b1-4eb1-808b-96c9fb390a69 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.670622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.671329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.671612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.671891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.672638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:42.672946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.674663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.694065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 409/811] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:42.694065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.723317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f1e50-01c9-4bc0-8762-8470a51cd2a7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.758373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.758977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.759251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.759522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.760516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:42.760516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.761838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.779223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 403/812] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:42.779223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.790083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:42.821609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0072a-1203-468a-b6d3-7c5ea897f8e1 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.857353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.858021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.858307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.858733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/8c4901865c4748b7855435c801e37ea0/roles/ed997874e38746a3992f92bfdfabfeec` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.873652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=8c4901865c4748b7855435c801e37ea0, role_id=ed997874e38746a3992f92bfdfabfeec)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.875077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.876757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccdeae-44a2-491d-831a-26da3ab95d37 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:42.877734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:42.888393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 410/813] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:42 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/8c4901865c4748b7855435c801e37ea0/roles/ed997874e38746a3992f92bfdfabfeec => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:42.889185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:42.925738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:42.926831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:42.927309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:42.927765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/1bc038af597c45648f6603d2ef6d685c/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:42.930063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=1bc038af597c45648f6603d2ef6d685c, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:42.931951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:42.947982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 404/814] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:42 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/1bc038af597c45648f6603d2ef6d685c/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:42.948969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.020184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a40d-4e98-44db-9212-12d9fbdcdb0f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.064091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:43.069775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0733e-617d-463c-b12a-a070d0ab9705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.071373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0733e-617d-463c-b12a-a070d0ab9705 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.071373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0733e-617d-463c-b12a-a070d0ab9705 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.071679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0733e-617d-463c-b12a-a070d0ab9705 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.072415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0733e-617d-463c-b12a-a070d0ab9705 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.073969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0733e-617d-463c-b12a-a070d0ab9705 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-48c0733e-617d-463c-b12a-a070d0ab9705 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:43.086740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:43.088004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:43.089068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 411/815] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:43.089922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeae05-4fad-4568-8396-e55de11c2663 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.089922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeae05-4fad-4568-8396-e55de11c2663 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.090053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeae05-4fad-4568-8396-e55de11c2663 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.091387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 412/816] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:43.096828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41a5d5-3d11-43cb-a214-03171d363745 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.097115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41a5d5-3d11-43cb-a214-03171d363745 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.097394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41a5d5-3d11-43cb-a214-03171d363745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.115838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065f8d-7588-4bb6-b7ac-d20d883fa6e3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.122856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-fb41a5d5-3d11-43cb-a214-03171d363745 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:43.125193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-fb41a5d5-3d11-43cb-a214-03171d363745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:43.159857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.160993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.161335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.161676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.170000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.171366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:43.187399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:43.188789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:43.190346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 405/817] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:15:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:43.190942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.198650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:43.216086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 413/818] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:43.216439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41a5d5-3d11-43cb-a214-03171d363745 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.320184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697956d5-e96d-4f20-8c36-f0e97eded3e8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.358175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:43.378249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.378841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.379128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.379398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.380046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:43.380376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.381770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.390427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41a5d5-3d11-43cb-a214-03171d363745 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.392745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 406/819] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 05:15:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:43.398035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.430846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.431830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.432383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.432854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.433794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:43.434297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.435922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.453895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 414/820] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:15:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:43.461354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.537951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57e706-93fd-4e31-95a2-78bf1b03c20b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.555278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:43.586325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.587272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.587725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.588490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.589150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:43.589454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.590829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.601951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 407/821] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 21 05:15:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:43.602692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.619570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa4149-6b79-4968-babb-15d441530afb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.660536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.661627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.662080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.662618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.671642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:43.732999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cafc-0e4a-4815-b105-3edf2ce1471d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.748237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.750247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.778082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.779117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.779457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.779789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] PATH_INFO: `/v3/services/network` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.780696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.782795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:43.795095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:43.796367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 05:15:43.797419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:43.800419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 408/822] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:43 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:43.801349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.808488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:43.886712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 415/823] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:15:43.887850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:43.948437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992b19-8069-40eb-bd76-7ad6fefa6f82 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:43.973759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:43.994013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:43.994629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:43.994908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:43.995176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:43.996083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:43.998596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:43.999907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154228d-d571-431c-9645-57d1fab6d335 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:44.032455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 409/824] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:15:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:44.033771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:44.077086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:44.078387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:44.078813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:44.079249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:44.080051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] RBAC: Adding query filter params (name=network) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:44.080597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:44.082175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:44.092174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 416/825] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:15:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:44.099523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:44.114099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:44.229792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8db284-0562-4c81-be28-756a756547c2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:44.310097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:44.310766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:44.311071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:44.311791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:44.333955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:44.335501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:44.363250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:44.364522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:44.365631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:44.365631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:44.365631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:44.368265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 410/826] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:44.374321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:44.386835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2202ee-8959-4680-92d5-9bb49e727b86 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:44.414195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:44.427759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:44.428498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:44.428846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:44.429184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:44.429879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:44.430246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:44.432421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:44.442291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 417/827] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:15:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:44.443618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:44.515585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9286f3-eada-4b9c-8af7-62ada528d2cc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:44.523088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:44.555135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:44.556522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:44.557078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:44.557487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:44.558430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:44.558895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:44.560725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:44.574108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 411/828] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:44.579680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:44.598111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dd010-ea49-4a1d-b554-168941b837d7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:44.637338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:44.638097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:44.638474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:44.638839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:44.639618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:44.641177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:44.676760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 418/829] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:15:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:44.760917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:44.778222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed3d76-7944-4b96-b272-c731ac5c80ac None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:44.842554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:44.843211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:44.843492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:44.843768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:44.862214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:44.863777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:44.882128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:44.883165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:44.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 412/830] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:44.889423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:45.005764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d28ebb-bcb7-4823-9b27-bd30e6687bb6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:45.031454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:45.041088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c75d-b619-46a8-8ed1-d6ac47b9dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:45.041709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c75d-b619-46a8-8ed1-d6ac47b9dc73 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.042350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c75d-b619-46a8-8ed1-d6ac47b9dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.042627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c75d-b619-46a8-8ed1-d6ac47b9dc73 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.043324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2c75d-b619-46a8-8ed1-d6ac47b9dc73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:45.044303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2c75d-b619-46a8-8ed1-d6ac47b9dc73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:45.045919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2c75d-b619-46a8-8ed1-d6ac47b9dc73 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:45.068155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 419/831] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:45.075344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:45.233108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0acb12-de1b-4862-9898-ba951542b753 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:45.271008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f9650-65e5-4001-9eff-92c3b538addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:45.271620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9650-65e5-4001-9eff-92c3b538addf None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.271899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9650-65e5-4001-9eff-92c3b538addf None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.272168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9650-65e5-4001-9eff-92c3b538addf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.273119 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f9650-65e5-4001-9eff-92c3b538addf None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=c83d5e7a41404bacb2b4d18daf040aa0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:45.273427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f9650-65e5-4001-9eff-92c3b538addf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:45.274916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f9650-65e5-4001-9eff-92c3b538addf None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:45.282357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 413/832] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:45 2022] GET /identity/v3/role_assignments?user.id=c83d5e7a41404bacb2b4d18daf040aa0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:45.359423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad989fe-5172-4564-94b8-dbdb4406e3e0 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.359951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad989fe-5172-4564-94b8-dbdb4406e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.359951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad989fe-5172-4564-94b8-dbdb4406e3e0 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.362138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 420/833] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:45.367802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec5fc-f124-4007-9b53-e142c7b3d83f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.368088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec5fc-f124-4007-9b53-e142c7b3d83f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.368404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec5fc-f124-4007-9b53-e142c7b3d83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.388730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f76ec5fc-f124-4007-9b53-e142c7b3d83f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:45.389961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f76ec5fc-f124-4007-9b53-e142c7b3d83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:45.392230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:45.408046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b93b3-9771-4f89-bc7c-6007e2fff65f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.408412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b93b3-9771-4f89-bc7c-6007e2fff65f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.408651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b93b3-9771-4f89-bc7c-6007e2fff65f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.410341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 421/834] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:45.415879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2c8f-43f2-4c04-8d35-775ad1aef27f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.416158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2c8f-43f2-4c04-8d35-775ad1aef27f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.416480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2c8f-43f2-4c04-8d35-775ad1aef27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.435578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-3cab2c8f-43f2-4c04-8d35-775ad1aef27f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:45.436853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3cab2c8f-43f2-4c04-8d35-775ad1aef27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:45.470523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 414/835] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:45.516081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 422/836] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:15:45.736966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec5fc-f124-4007-9b53-e142c7b3d83f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:45.785853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2c8f-43f2-4c04-8d35-775ad1aef27f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:45.845568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec5fc-f124-4007-9b53-e142c7b3d83f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:45.889534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:45.890167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.890518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.890727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.898511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:45.902366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2c8f-43f2-4c04-8d35-775ad1aef27f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:45.903430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:45.908716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:45.909842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:15:45.910673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:45.915576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 415/837] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:45.916619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:45.928617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:45.947858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:45.948741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:45.949542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:45.949895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:45.964506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:45.971173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:45.973256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:45.974945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 423/838] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:45.983132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.044503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c73ce8-0ef0-4fc6-9ca9-a512b91af297 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.090406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.091372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.092003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.092910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.094070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:46.094591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.096697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.107748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 416/839] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:46.113838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.114390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4bb02-f36f-4024-9306-56ff8acdbd45 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.151764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.152953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.153588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.154059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.154921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:46.155420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.157014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.170984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 424/840] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:46.172153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.180922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:46.216982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:46.229582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26377-4bc7-42bd-b452-9fe4681a0adb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.268900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.269965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.270455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.270964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.282430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b72b-c38d-4ebf-91d5-b2ed6fa79ac6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.283162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.285205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:46.302887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:46.303859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:46.304886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:46.304886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:46.304886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:46.311562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 417/841] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:46.312998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.321434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.322069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.322350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.322630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.333857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.335423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:46.350553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:46.351537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:46.352461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:46.352461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:46.352461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:46.352461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 425/842] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:46.358830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.445181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848becf-9fcf-49de-9cf5-74837a40039c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.463243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:46.483206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:46.494023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.494919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.495305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a529c54-68bd-4a41-8642-ce5b2b5d49d1 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.495614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.496118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.497225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:46.498950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.500755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.522439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 418/843] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:46.523672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.540532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.541229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.541510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.541827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.542827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:46.542827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.544218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.562412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 426/844] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:46.563621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.647533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767c2d-6b70-46b4-91c8-417a5efcab73 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.684806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527290ea-8376-4c71-9d08-c8c962ebe909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.685442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527290ea-8376-4c71-9d08-c8c962ebe909 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.685726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527290ea-8376-4c71-9d08-c8c962ebe909 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.686002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527290ea-8376-4c71-9d08-c8c962ebe909 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.693391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9944-d1e4-4112-a6eb-6e664f695a54 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.693701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527290ea-8376-4c71-9d08-c8c962ebe909 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.695143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527290ea-8376-4c71-9d08-c8c962ebe909 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-527290ea-8376-4c71-9d08-c8c962ebe909 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:46.707209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:46.708207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:46.709182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 419/845] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:46.709774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8d59-a03c-4297-bb9c-e8cbaecbfc8f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.709774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8d59-a03c-4297-bb9c-e8cbaecbfc8f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.710530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8d59-a03c-4297-bb9c-e8cbaecbfc8f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.711331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 420/846] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:46.713730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d8d59-a03c-4297-bb9c-e8cbaecbfc8f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.736542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b2057-e5be-408d-bade-e639f95e59ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.737768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b2057-e5be-408d-bade-e639f95e59ab None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.738045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b2057-e5be-408d-bade-e639f95e59ab None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.738311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b2057-e5be-408d-bade-e639f95e59ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.745772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b2057-e5be-408d-bade-e639f95e59ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.747209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b2057-e5be-408d-bade-e639f95e59ab None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.748237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-9a9b2057-e5be-408d-bade-e639f95e59ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:46.758902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:46.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:46.760839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 427/847] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:46.761429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45492f8-312d-4663-8122-e53d1c208eb7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.761505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45492f8-312d-4663-8122-e53d1c208eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.762459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45492f8-312d-4663-8122-e53d1c208eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.779154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d45492f8-312d-4663-8122-e53d1c208eb7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:46.780334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d45492f8-312d-4663-8122-e53d1c208eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:46.784562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:46.832197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d8d59-a03c-4297-bb9c-e8cbaecbfc8f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:46.853548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 428/848] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:46.865593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45492f8-312d-4663-8122-e53d1c208eb7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.874547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:46.875156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:46.875435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:46.875709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:46.876470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:46.876780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:46.879845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:46.902557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 421/849] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:46.903893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:46.983696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45492f8-312d-4663-8122-e53d1c208eb7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.024450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.025781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.026753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.027488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.027958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.029103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:47.029900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.032667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.036467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc173-e1fe-46e4-9cd4-25434cc5d8ff None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.045034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.062296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 429/850] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:47.064259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.077138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.077741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.078073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.078388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.153194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.155010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.195077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e521394-1f1d-4f18-9d6c-cc7372941b5d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.237405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.238130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.238409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.238860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.244131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.255689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 422/851] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:15:47.256450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.312584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.317090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.318918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.357876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcacfa8-9c4f-45c0-a34e-c6ff18f59a33 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.395072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.396086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.396573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.397200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.397917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.399543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:47.409018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:47.410181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:47.411202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:47.413763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 423/852] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:47.414783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.424940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 430/853] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:15:47.429568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.476663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.526001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb50d10-ac77-4c04-851c-d69ff65f499d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.532498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.537953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3648-ad2f-487a-b87d-0360e7cd431c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.565327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.566098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.566383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.566769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.574200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.574987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.575269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.575544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.576175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:47.576506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.577836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.577956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.579508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.582429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 431/854] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:47.583342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:47.595563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:47.596658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:47.602251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:47.602251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:47.602251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:47.602251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 424/855] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:47.602251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.685947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcba279-c579-454a-a586-5691ac109c06 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.700881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df79ba-5d50-4ceb-8b92-990ed1af6762 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.708323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.719675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc5302-dd88-48dc-88e2-b07fe91d937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.720324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc5302-dd88-48dc-88e2-b07fe91d937b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.720608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc5302-dd88-48dc-88e2-b07fe91d937b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.720879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc5302-dd88-48dc-88e2-b07fe91d937b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.731482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc5302-dd88-48dc-88e2-b07fe91d937b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.732977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc5302-dd88-48dc-88e2-b07fe91d937b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.734864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.735468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.735751 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.736027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.737200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:47.737508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.738860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.743156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 425/856] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:47.743925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-23cc5302-dd88-48dc-88e2-b07fe91d937b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:47.749611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:47.750584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:47.751469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:47.751469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:47.751469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:47.751469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 432/857] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:47.753025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1c85-486c-4bbe-b177-22a74583c1f7 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.753025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1c85-486c-4bbe-b177-22a74583c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.753295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1c85-486c-4bbe-b177-22a74583c1f7 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.755340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 433/858] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:47.761254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcaead-91a3-4fac-8c3c-6e22f73151a5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.761572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcaead-91a3-4fac-8c3c-6e22f73151a5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.762310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcaead-91a3-4fac-8c3c-6e22f73151a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.783275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-fadcaead-91a3-4fac-8c3c-6e22f73151a5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:47.784572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-fadcaead-91a3-4fac-8c3c-6e22f73151a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:47.794798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:47.863983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078bec-d894-4f52-8d28-f822b0cb552a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:47.868031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 434/859] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:15:47.869178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcaead-91a3-4fac-8c3c-6e22f73151a5 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.914654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:47.915577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:47.916051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:47.916525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:47.917341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:47.917828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:47.919874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:47.936264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 426/860] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:47.940897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:47.972802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:48.000678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcaead-91a3-4fac-8c3c-6e22f73151a5 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.045933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.046555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.047089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.047368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.048493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:48.049640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.051666 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.054559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ffb13-e24b-4544-8555-9b38ad3ecd00 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.065589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 435/861] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:48.072019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.075673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:48.096613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.097251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.097534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.097809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.104927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.106382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:48.118477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:48.119386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:48.121310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:48.124680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 427/862] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:48.125687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.180871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0682a-a38e-4d7e-a419-205fc021fa38 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.215805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.216390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.216670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.216946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.223959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.225425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.225544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:48.236299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4da9-b210-4784-8920-7e7aa4f76304 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:48.237850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:48.238711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 436/863] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:48.244468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.279886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.280529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.280815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.281090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.281778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:48.282086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.284171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.302480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 428/864] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:48.303295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.306771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:48.349234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4c470-c12a-49f7-8c8d-e14214d2f035 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.383696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.384368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.384657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.384932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.385518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.386877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:48.395975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:48.396934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:48.397825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 437/865] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:48.398638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.413764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca935746-e206-4e33-ab8a-10d465023094 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.449380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.450153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.450444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.450837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.451525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:48.451834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.453311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.472648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 429/866] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:48.472648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.484834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:48.509201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a742c22-099f-41b2-b0a1-089065900afe None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.536805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:48.546679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.547282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.547561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.547831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.548586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=8c4901865c4748b7855435c801e37ea0) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:48.548919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.550335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.564315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 438/867] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/role_assignments?user.id=8c4901865c4748b7855435c801e37ea0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:48.564315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.591664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6ab4-053f-4e21-aa03-2abbca7394cd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.639300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.639929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.640208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.640507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.641350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:48.641690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.644315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.651353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 430/868] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:48.657406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:48.686080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d6373-45c2-4119-9ef0-b6dfa261d2ae None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.727941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870c0a3-d80f-425b-8cb8-e71294c144e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.728509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c0a3-d80f-425b-8cb8-e71294c144e9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.728839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c0a3-d80f-425b-8cb8-e71294c144e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.729110 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c0a3-d80f-425b-8cb8-e71294c144e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.729880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c0a3-d80f-425b-8cb8-e71294c144e9 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=1bc038af597c45648f6603d2ef6d685c) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:48.730162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c0a3-d80f-425b-8cb8-e71294c144e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.731631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c0a3-d80f-425b-8cb8-e71294c144e9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.744801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 439/869] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/role_assignments?user.id=1bc038af597c45648f6603d2ef6d685c&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:48.749342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:48.781886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb33ba-7512-4c97-8fdd-15429e869931 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:48.821013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a2d34-1e68-4caa-8599-aefa58990771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:48.821984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a2d34-1e68-4caa-8599-aefa58990771 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:48.822549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a2d34-1e68-4caa-8599-aefa58990771 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:48.823013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a2d34-1e68-4caa-8599-aefa58990771 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:48.823906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a2d34-1e68-4caa-8599-aefa58990771 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:48.824441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a2d34-1e68-4caa-8599-aefa58990771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:48.826065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a2d34-1e68-4caa-8599-aefa58990771 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:48.832319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 431/870] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:49.965952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7409b-c6cd-4422-9099-feceb95e6dde None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:49.966464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7409b-c6cd-4422-9099-feceb95e6dde None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:49.966538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7409b-c6cd-4422-9099-feceb95e6dde None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:49.968048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 440/871] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:49.974036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825993-f660-4994-aea9-55a430996822 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:49.974441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825993-f660-4994-aea9-55a430996822 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:49.974609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825993-f660-4994-aea9-55a430996822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:49.992784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2e825993-f660-4994-aea9-55a430996822 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:49.993965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2e825993-f660-4994-aea9-55a430996822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:50.062792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 432/872] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:50.333248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7409b-c6cd-4422-9099-feceb95e6dde None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:50.393568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:50.441615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7409b-c6cd-4422-9099-feceb95e6dde None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:50.478640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ce83b-6130-42db-8600-1228c45c35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:50.479251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ce83b-6130-42db-8600-1228c45c35ff None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:50.479532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ce83b-6130-42db-8600-1228c45c35ff None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:50.479803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ce83b-6130-42db-8600-1228c45c35ff None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:50.480507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ce83b-6130-42db-8600-1228c45c35ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:50.481862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ce83b-6130-42db-8600-1228c45c35ff None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:50.502871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 441/873] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:15:50 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:50.927185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aa364-e41d-43b8-95fa-bf892d86f7f5 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:50.927185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aa364-e41d-43b8-95fa-bf892d86f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:50.927185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aa364-e41d-43b8-95fa-bf892d86f7f5 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:50.927917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 433/874] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:50.933455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8576ef-e86d-4ab2-9f2f-930e44b768db None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:50.933972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8576ef-e86d-4ab2-9f2f-930e44b768db None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:50.934448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8576ef-e86d-4ab2-9f2f-930e44b768db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:50.947397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc26e3-136c-4e6a-96e4-2f8ddcf09c7a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:50.947713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc26e3-136c-4e6a-96e4-2f8ddcf09c7a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:50.947939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc26e3-136c-4e6a-96e4-2f8ddcf09c7a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:50.949418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 434/875] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:50.954494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd8c83-2611-4a8f-8919-b99fcc690595 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:50.954777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd8c83-2611-4a8f-8919-b99fcc690595 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:50.955080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd8c83-2611-4a8f-8919-b99fcc690595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:50.956249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ba8576ef-e86d-4ab2-9f2f-930e44b768db None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:50.957731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ba8576ef-e86d-4ab2-9f2f-930e44b768db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:50.978102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bbdd8c83-2611-4a8f-8919-b99fcc690595 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:50.980191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bbdd8c83-2611-4a8f-8919-b99fcc690595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:51.048319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 442/876] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:51.059827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:51.072373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 435/877] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:15:51.104143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7381df-df98-4cf7-a2e1-fef7a1156d4f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.104461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7381df-df98-4cf7-a2e1-fef7a1156d4f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.104740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7381df-df98-4cf7-a2e1-fef7a1156d4f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.106316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 443/878] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:51.111413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e6a0-d0cc-4105-9b41-50ebcf8d4beb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.111641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e6a0-d0cc-4105-9b41-50ebcf8d4beb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.111912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e6a0-d0cc-4105-9b41-50ebcf8d4beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.130787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8343e6a0-d0cc-4105-9b41-50ebcf8d4beb None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:51.131945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8343e6a0-d0cc-4105-9b41-50ebcf8d4beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:51.199966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 436/879] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:51.332322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7381df-df98-4cf7-a2e1-fef7a1156d4f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:51.353036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343e6a0-d0cc-4105-9b41-50ebcf8d4beb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:51.389000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:51.465151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7381df-df98-4cf7-a2e1-fef7a1156d4f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:51.481272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343e6a0-d0cc-4105-9b41-50ebcf8d4beb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:51.503608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:51.504249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.504555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.504824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.511860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:51.517835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:51.521360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:51.522295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:51.522713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:51.523713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:15:51.529416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:51.530528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.530528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.530528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:51.530772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 444/880] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 21 05:15:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:51.530772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:51.530948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:51.542260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:51.543316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:51.549750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 437/881] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:51.550552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:51.640358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc7589-9665-407d-bb6b-655c9ba8a966 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:51.641925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:51.656416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de6815-a518-4982-bd80-02657ae056cc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:51.677465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:51.678172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.678460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.678734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.679392 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:51.680803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:51.696491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 445/882] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:15:51 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:51.697354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:51.711382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:51.712603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.713176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.713674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.714600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:51.715165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:51.717029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:51.733454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 438/883] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 21 05:15:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:51.734455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:51.791752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:51.837901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92dbe0-e8db-4187-b27b-a83b513de097 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:51.855753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c4f0d-1a1a-4e49-9d4d-a46d46cbcb09 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:51.885961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:51.887264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.887857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.888138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.888815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:51.889121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:51.890579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:51.896139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 446/884] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:15:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:51.904027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:51.908802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:51.909615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:51.910048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:51.910777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:51.921497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:51.922949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:51.939838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:51.941019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:51.941990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:51.941990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:51.941990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:51.942426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:51.944093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 439/885] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:51.947952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:52.028925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7828a3f-b7ae-4318-b820-ff09f2b51835 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:52.069169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:52.069814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:52.070139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:52.070482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:52.071180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:52.071564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:52.073048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:52.073464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11cc4b-a0fe-4530-8bf1-3f2417409d1d None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:52.075492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:52.079653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 447/886] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:15:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:52.119871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:52.120538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:52.120818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:52.121090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:52.121744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:52.122044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:52.123683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:52.143308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 440/887] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:52.144713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:52.250017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:52.264446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b9fa9-4508-4aa7-9005-204025b86ec2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:52.301348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:52.302343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:52.302852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:52.303358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:52.311543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:52.313286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:52.325779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:52.326770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:52.327736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:52.330280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 448/888] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:15:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:52.336336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:52.440188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6d3e-41ae-4f7e-bf0f-3285c49e0bcb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:52.475769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c11b66-c686-429d-be3d-766799542865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:52.476406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c11b66-c686-429d-be3d-766799542865 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:52.476686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c11b66-c686-429d-be3d-766799542865 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:52.476955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c11b66-c686-429d-be3d-766799542865 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:52.477680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c11b66-c686-429d-be3d-766799542865 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:52.477981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c11b66-c686-429d-be3d-766799542865 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:52.479406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c11b66-c686-429d-be3d-766799542865 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:52.502779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 441/889] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 21 05:15:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:52.504109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:52.615069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc811d2-2187-4b77-807e-ca7a506b3331 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:52.655776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:52.657113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:52.657611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:52.658092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:52.683099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:52.717459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622006-34bd-4e85-a30d-74f837702cf2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:52.717650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622006-34bd-4e85-a30d-74f837702cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:52.717924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622006-34bd-4e85-a30d-74f837702cf2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:52.723944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 442/890] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:15:52.725909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876de6b0-e3f3-4e16-97ee-812380a216c3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:52.726672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876de6b0-e3f3-4e16-97ee-812380a216c3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:52.727574 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876de6b0-e3f3-4e16-97ee-812380a216c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:52.740552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:52.742081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:52.751248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-876de6b0-e3f3-4e16-97ee-812380a216c3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:52.753251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-876de6b0-e3f3-4e16-97ee-812380a216c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:52.771217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:52.841546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 443/891] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:52.862079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 449/892] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:15:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:15:52.870438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876de6b0-e3f3-4e16-97ee-812380a216c3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:52.981455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876de6b0-e3f3-4e16-97ee-812380a216c3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.021885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.022527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.022808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.023084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.034457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.035918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:53.052457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:53.053472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:53.054594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:53.054594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:53.054594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:53.054594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 444/893] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:53.060936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.110770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:53.164768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e31bea-5b03-4fe0-bd78-53b158c7b641 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.174884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.177975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:53.207350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.207976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.208260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.208568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.209286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:53.209529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.210890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.237997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 450/894] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:53.239688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.301843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb869-1822-4ef1-baff-76f48b8de50e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.348598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf075f0-c66d-4c32-aaf8-7ee42a54868c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.357392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.358028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.358303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.358573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.359147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.360533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.365231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:53.375586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:53.376660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:53.378070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:53.384503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 445/895] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:53.387374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.401394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.402801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.403367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.403982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.412815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.415279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:53.430369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:53.431345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:53.432244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:53.436093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 451/896] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:53.440327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.464801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:53.500960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc8cf-8dea-4884-9cf5-527b8d77463a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.544602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.545235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.545954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.546234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.546864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:53.547171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.549505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.560485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 446/897] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:53.561788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.567098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a8bb-c9e7-4efc-aa79-19bbe9b6fa7f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.606236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.607197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.607697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.608179 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.609121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:53.609664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.611914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.625802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 452/898] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:53.632442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.665174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:53.686146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a1c3f-3315-46a4-acab-669a2a85226c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.717493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:53.724101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.725948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.726476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.727059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.728020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:53.728576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.730151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.735940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 447/899] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:53.744180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.746463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ab3c9-e120-4546-a4bf-5bb1ec895a09 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.787482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.788096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.788414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.788691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.789529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] RBAC: Adding query filter params (role.id=50f2777d68ba446096ad0ff35589fe62, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=8c4901865c4748b7855435c801e37ea0) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:53.789843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.791276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.799414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 453/900] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/role_assignments?user.id=8c4901865c4748b7855435c801e37ea0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=50f2777d68ba446096ad0ff35589fe62 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:53.870528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b15a0-251a-4990-8168-dc9cbb15159c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:53.911136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd70ddf-ad1c-467f-b2e3-3fb03da9ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:53.911768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd70ddf-ad1c-467f-b2e3-3fb03da9ac81 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.912050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd70ddf-ad1c-467f-b2e3-3fb03da9ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.912346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd70ddf-ad1c-467f-b2e3-3fb03da9ac81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.913070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd70ddf-ad1c-467f-b2e3-3fb03da9ac81 None admin] RBAC: Adding query filter params (interface=public, service_id=210da9534e99496c9c949569ee48b72d, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:53.913378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd70ddf-ad1c-467f-b2e3-3fb03da9ac81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:53.914909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd70ddf-ad1c-467f-b2e3-3fb03da9ac81 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:53.924342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 448/901] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/endpoints?service_id=210da9534e99496c9c949569ee48b72d&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:53.933499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:53.962591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7845a-392d-4809-85cd-4a1b2d2432c6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.962941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7845a-392d-4809-85cd-4a1b2d2432c6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.963162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7845a-392d-4809-85cd-4a1b2d2432c6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.964802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 449/902] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:53.970289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44701c-bb1c-4729-b8c1-2c81f63814e8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:53.971093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44701c-bb1c-4729-b8c1-2c81f63814e8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:53.971382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44701c-bb1c-4729-b8c1-2c81f63814e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:53.995999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3e44701c-bb1c-4729-b8c1-2c81f63814e8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:53.996937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3e44701c-bb1c-4729-b8c1-2c81f63814e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:54.051574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:54.061084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18d1a-2552-439d-ae2f-87faa81f54fb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:54.063233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:54.084647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 450/903] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:15:54.101209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730df4b0-fc9c-4184-9989-baba85b15071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:54.102099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df4b0-fc9c-4184-9989-baba85b15071 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:54.102602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df4b0-fc9c-4184-9989-baba85b15071 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:54.103072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df4b0-fc9c-4184-9989-baba85b15071 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:54.103870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df4b0-fc9c-4184-9989-baba85b15071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:54.105477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df4b0-fc9c-4184-9989-baba85b15071 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:54.112346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 454/904] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:15:53 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:15:54.352858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44701c-bb1c-4729-b8c1-2c81f63814e8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:54.407249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94063-76fd-40ba-ad3c-83d82bfbfc92 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:54.407588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94063-76fd-40ba-ad3c-83d82bfbfc92 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:54.407820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94063-76fd-40ba-ad3c-83d82bfbfc92 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:54.409484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 455/905] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:54.414710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cde4d-cdc5-459f-a6cf-519ab32ecd35 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:54.414997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cde4d-cdc5-459f-a6cf-519ab32ecd35 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:54.415273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cde4d-cdc5-459f-a6cf-519ab32ecd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:54.438239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4d8cde4d-cdc5-459f-a6cf-519ab32ecd35 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:54.440064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4d8cde4d-cdc5-459f-a6cf-519ab32ecd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:54.467033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44701c-bb1c-4729-b8c1-2c81f63814e8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:54.510979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:54.511913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:54.512487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:54.513202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:54.514219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:54.515943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:54.524616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 456/906] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:54.525296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:54.526415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:54.527528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:54.529858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 451/907] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 21 05:15:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:54.539898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cde4d-cdc5-459f-a6cf-519ab32ecd35 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:54.631466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:54.643949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cde4d-cdc5-459f-a6cf-519ab32ecd35 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:54.679360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:54.679971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:54.680246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:54.680553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:54.681184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:54.681485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:54.682855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:54.687766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 457/908] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:54.693425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:54.750872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:54.804172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8356e1-b488-43f7-b03d-eaa6462d2348 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:54.827689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:54.846536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:54.847540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:54.848050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:54.848644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:54.849588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:54.849899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:54.851299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:54.861794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 452/909] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:54.868012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:54.965968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa9f5-1c30-4d90-a072-5cbdb31b3539 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:54.979524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a42a7-71ab-4d35-b8e7-2495e9b020c9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:54.997903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:55.009783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37538ae-e267-4be1-919a-2b6b52f4384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:55.010785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37538ae-e267-4be1-919a-2b6b52f4384b None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:55.011298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37538ae-e267-4be1-919a-2b6b52f4384b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:55.011709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37538ae-e267-4be1-919a-2b6b52f4384b None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:55.012569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37538ae-e267-4be1-919a-2b6b52f4384b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:55.014726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37538ae-e267-4be1-919a-2b6b52f4384b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:55.019216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:55.019838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:55.020118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:55.020430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:55.021277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] RBAC: Adding query filter params (interface=public, service_id=aa296bac6c87449a9166bf38a591d9ca, region_id=RegionOne) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:55.021687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:55.023170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:55.028926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 453/910] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:15:54 2022] GET /identity/v3/endpoints?service_id=aa296bac6c87449a9166bf38a591d9ca&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:15:55.034780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:55.038969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 458/911] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:15:54 2022] POST /identity/v3/services => generated 241 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:15:55.154788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b53709-d3fb-475b-bffc-99682d4098f0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:55.199886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c9e4-48cf-42af-9dee-06973b339191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:55.200545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c9e4-48cf-42af-9dee-06973b339191 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:55.200823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c9e4-48cf-42af-9dee-06973b339191 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:55.201093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c9e4-48cf-42af-9dee-06973b339191 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:55.201694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24c9e4-48cf-42af-9dee-06973b339191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:55.203140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24c9e4-48cf-42af-9dee-06973b339191 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:55.210713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 454/912] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:15:55 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:15:56.137437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc711fe-5310-4e76-8e8f-ce5e52dc8dd1 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:56.137957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc711fe-5310-4e76-8e8f-ce5e52dc8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:56.137957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc711fe-5310-4e76-8e8f-ce5e52dc8dd1 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:56.139469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 459/913] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:56.145397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aa2a2-b63c-462a-94ce-c422859f32c9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:56.145785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aa2a2-b63c-462a-94ce-c422859f32c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:56.145978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aa2a2-b63c-462a-94ce-c422859f32c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:56.165060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cf5aa2a2-b63c-462a-94ce-c422859f32c9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:56.166249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cf5aa2a2-b63c-462a-94ce-c422859f32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:56.206904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:56.241727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 455/914] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:15:56.300736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71b5c-b2e2-47df-a6d0-83ee6d0fbcbe None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:56.301081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71b5c-b2e2-47df-a6d0-83ee6d0fbcbe None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:56.301293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71b5c-b2e2-47df-a6d0-83ee6d0fbcbe None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:56.302886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 460/915] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:56.310222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd479b3-265c-463e-bd85-bcd0ea3f354c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:56.310508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd479b3-265c-463e-bd85-bcd0ea3f354c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:56.310780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd479b3-265c-463e-bd85-bcd0ea3f354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:56.329526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cdd479b3-265c-463e-bd85-bcd0ea3f354c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:56.331057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cdd479b3-265c-463e-bd85-bcd0ea3f354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:56.403251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 456/916] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:56.520630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71b5c-b2e2-47df-a6d0-83ee6d0fbcbe None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:56.535708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:56.627950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71b5c-b2e2-47df-a6d0-83ee6d0fbcbe None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:56.661258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:56.661812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:56.662144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:56.662420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:56.673242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:15:56.678453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:56.679368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:15:56.680201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:56.684468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 461/917] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 21 05:15:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:56.685947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd479b3-265c-463e-bd85-bcd0ea3f354c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:56.718977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:56.790978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:56.794582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:56.797964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd479b3-265c-463e-bd85-bcd0ea3f354c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:56.827132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca92b-4430-4cf2-8312-a205f1278305 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:56.848403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:56.849056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:56.849332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:56.849602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:56.850482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:56.850783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:56.852164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:56.869446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 457/918] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 21 05:15:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:56.870800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:56.874301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:56.875233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:56.875727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:56.876212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:56.877595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:56.879198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:56.888737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:56.889747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 05:15:56.890583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:56.898494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 462/919] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:56.899680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:56.978397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc2837-5cf2-4679-b857-faad16d4116e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.006877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3778af5-406e-4ce8-a09c-9d2e1438325a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.024176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.025186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.025698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.026176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.038308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.040034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.050120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.050746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.051032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.051310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.052226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:57.052560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.053922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.055801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:57.057898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:57.058816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:57.059699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:57.059699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:57.059699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:57.060032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 463/920] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:57.062107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 458/921] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:57.069199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.069360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.085626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:57.180026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8a0a0-d072-49db-85a9-c97e90de14cd None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.210114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086820e-0bbe-4ceb-9488-bc9c14061218 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.229194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.229731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.230020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.230488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.231146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:57.231455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.232884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.239774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 464/922] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 21 05:15:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:57.247421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.259720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.260454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.260834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.261170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.261872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:57.262241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.263723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.277261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 459/923] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:57.287394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.319325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:57.364216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fad35-1598-4cfe-bbfa-2cd74b2ce5d7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.381413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:57.405604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5168d-72a3-4004-9278-b406df045b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.406392 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5168d-72a3-4004-9278-b406df045b4c None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.406671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5168d-72a3-4004-9278-b406df045b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.406946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5168d-72a3-4004-9278-b406df045b4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.407619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5168d-72a3-4004-9278-b406df045b4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.409585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5168d-72a3-4004-9278-b406df045b4c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.411395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090669-c673-4e77-b2d7-d562427df47c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.440311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 465/924] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:15:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:15:57.440311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2671-8bb7-4cdd-9e69-d9068d2fc491 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.440311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2671-8bb7-4cdd-9e69-d9068d2fc491 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.440311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2671-8bb7-4cdd-9e69-d9068d2fc491 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.440311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 466/925] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:57.440311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75677-64bb-4bb2-9479-2380a54f2187 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.440311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75677-64bb-4bb2-9479-2380a54f2187 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.440982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75677-64bb-4bb2-9479-2380a54f2187 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.440982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 467/926] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:57.441528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b440aa2-973c-4b56-9dfd-c6d4bd12bd2a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.441923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b440aa2-973c-4b56-9dfd-c6d4bd12bd2a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.442226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b440aa2-973c-4b56-9dfd-c6d4bd12bd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.462343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7b440aa2-973c-4b56-9dfd-c6d4bd12bd2a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:57.463594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7b440aa2-973c-4b56-9dfd-c6d4bd12bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:57.465697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545db90-82f4-422b-a928-6efc7273f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.466343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545db90-82f4-422b-a928-6efc7273f61d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.466619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545db90-82f4-422b-a928-6efc7273f61d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.466891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545db90-82f4-422b-a928-6efc7273f61d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.475438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545db90-82f4-422b-a928-6efc7273f61d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.476954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545db90-82f4-422b-a928-6efc7273f61d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-d545db90-82f4-422b-a928-6efc7273f61d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:15:57.490084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:57.491277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:15:57.492498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:57.496133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 460/927] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:15:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:57.497929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504ad2-37c9-48ef-a771-03e5bbf1882d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.498214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504ad2-37c9-48ef-a771-03e5bbf1882d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.498487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504ad2-37c9-48ef-a771-03e5bbf1882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.519424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-61504ad2-37c9-48ef-a771-03e5bbf1882d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:57.520868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-61504ad2-37c9-48ef-a771-03e5bbf1882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:57.555376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 468/928] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:57.557358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b440aa2-973c-4b56-9dfd-c6d4bd12bd2a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.616709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 461/929] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:15:57.625007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:57.684883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b440aa2-973c-4b56-9dfd-c6d4bd12bd2a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.718827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.719438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.719715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.719983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.721259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:57.721562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.722983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.741433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 469/930] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 21 05:15:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:57.746762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61504ad2-37c9-48ef-a771-03e5bbf1882d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.807361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:57.829756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.870186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61504ad2-37c9-48ef-a771-03e5bbf1882d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.915192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:57.915826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:57.916109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:57.916489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:57.927334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:57.928858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:15:57.944150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:57.945145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:15:57.946034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:15:57.946034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:15:57.946034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:57.946034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 462/931] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:57.946034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:57.960711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bce10-484b-4e8e-9a97-8f8ead4d50a2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:57.972303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.000408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.001076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.001357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.001707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.002405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.003811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:58.013341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:58.014303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:15:58.015194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 470/932] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 21 05:15:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:15:58.015994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.058210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9242f3-2adc-457e-9e87-9134430e1096 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.070824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.093115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.093756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.094035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.094307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.094891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.096893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:58.105651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:58.106657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:58.107503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 463/933] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:58.108320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.131155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2908-9c93-4557-b19b-962a1cfd2b19 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.166645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.167263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.167543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.167818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.168517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:58.168823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.170307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.183693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 471/934] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:58.184590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.218891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c470db-82e2-4eb7-86a5-f74f80bcb312 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.229759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.255357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.255882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.256164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.256468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.257094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:58.257402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.258777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.263552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 464/935] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:58.268769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.308331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8c262-c1f5-4507-894a-b1b36f108569 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.308728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.342753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.343359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.343638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.343909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.344569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:58.344879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.346894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.351778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 472/936] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:58.353128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.371648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d83b3-52ef-4a72-93c7-2dbb92cb95ec None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.405572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.406200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.406478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.406755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.413955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.415393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:15:58.427998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:15:58.429091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:15:58.430149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:15:58.434236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 465/937] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:15:58.435083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.465984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.474065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9253-6e43-4e0a-91e7-7643f1080e74 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.512164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.513551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.514047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.514556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.515344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:58.515811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.518184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.525136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 473/938] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:58.530547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.540151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.544304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d60e04-d087-4ffd-95c3-105b7ca639e1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.583486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.584090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.584399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.584675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.585403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:58.585604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.587047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.596426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 466/939] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:58.597458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.645511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5098e3-1690-4feb-a6a9-7f235ca6fa23 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.683193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.683805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.684084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.684378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.685065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:58.685369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.686785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.699169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 474/940] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:58.699970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.709279 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568289a-303b-4b6e-9227-5c268ff0139f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.723644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.744021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.744654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.744936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.745209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.745871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.747247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.771134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 467/941] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:15:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:15:58.771134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.796409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:58.839444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec31b3-b468-4a08-ae5d-186823e774cb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.900804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1f53-4362-4547-8612-863e17084692 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:58.901228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.901860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.902144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.902713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.904469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] RBAC: Adding query filter params (interface=public, service_id=799bdd97de714682b9b68979428d1819, region_id=RegionOne) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:15:58.904790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.906195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.914025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 475/942] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/endpoints?service_id=799bdd97de714682b9b68979428d1819&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:15:58.919552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:15:58.947321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d58b1-8c78-4e10-9985-d9d04b15a999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:58.948042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d58b1-8c78-4e10-9985-d9d04b15a999 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:58.948348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d58b1-8c78-4e10-9985-d9d04b15a999 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:58.948690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d58b1-8c78-4e10-9985-d9d04b15a999 None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/8c4901865c4748b7855435c801e37ea0/roles/50f2777d68ba446096ad0ff35589fe62` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:58.951026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d58b1-8c78-4e10-9985-d9d04b15a999 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=8c4901865c4748b7855435c801e37ea0, role_id=50f2777d68ba446096ad0ff35589fe62)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:58.952708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d58b1-8c78-4e10-9985-d9d04b15a999 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:58.969300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 468/943] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:15:58 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/8c4901865c4748b7855435c801e37ea0/roles/50f2777d68ba446096ad0ff35589fe62 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:15:59.023317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:15:59.046654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4b079-e4ba-49a0-9d97-cc39a19fe096 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:15:59.085983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b387c19-1a8b-4c80-958c-13190da22f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:15:59.086610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b387c19-1a8b-4c80-958c-13190da22f62 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:59.086894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b387c19-1a8b-4c80-958c-13190da22f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:59.087167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b387c19-1a8b-4c80-958c-13190da22f62 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:59.087847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b387c19-1a8b-4c80-958c-13190da22f62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:15:59.089320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b387c19-1a8b-4c80-958c-13190da22f62 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:15:59.097641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 476/944] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:15:58 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:15:59.740369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db30f1e-73ab-4400-acaf-eddd72f13942 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:59.740889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db30f1e-73ab-4400-acaf-eddd72f13942 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:59.740889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db30f1e-73ab-4400-acaf-eddd72f13942 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:59.742506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 469/945] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:15:59.748221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b68a6a-449a-495a-95cf-28d41940f549 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:15:59.748659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b68a6a-449a-495a-95cf-28d41940f549 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:15:59.748832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b68a6a-449a-495a-95cf-28d41940f549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:15:59.767885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-59b68a6a-449a-495a-95cf-28d41940f549 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:15:59.769525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-59b68a6a-449a-495a-95cf-28d41940f549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:15:59.851055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 477/946] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:15:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:00.114374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db30f1e-73ab-4400-acaf-eddd72f13942 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:00.199229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:00.225622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db30f1e-73ab-4400-acaf-eddd72f13942 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:00.261662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:00.262260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:00.262544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:00.262824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:00.263537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:00.265018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:00.268157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING keystone.server.flask.common [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 21 05:16:00.288446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.sql.core [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 05:16:00.288446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 05:16:00.288446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [parameters: {'id': '7d7abc010ddf48a7aab4f1928317742c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 05:16:00.288446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d7abc010ddf48a7aab4f1928317742c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d7abc010ddf48a7aab4f1928317742c. Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 05:16:00.295748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 21 05:16:00.296577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application yield resource Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise self.value Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application session.commit() Sep 21 05:16:00.297537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.flush() Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application compat.raise_( Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 05:16:00.298454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 05:16:00.299904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 05:16:00.302031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [parameters: {'id': '7d7abc010ddf48a7aab4f1928317742c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:00.304127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:00.307375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d7abc010ddf48a7aab4f1928317742c. Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:00.316019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 470/947] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 21 05:16:00 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:00.317728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b68a6a-449a-495a-95cf-28d41940f549 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:00.383921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:00.409347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b68a6a-449a-495a-95cf-28d41940f549 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:00.443840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a2b2e-51d8-439a-a8a0-8104ce5da419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:00.444495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a2b2e-51d8-439a-a8a0-8104ce5da419 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:00.444773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a2b2e-51d8-439a-a8a0-8104ce5da419 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:00.445042 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a2b2e-51d8-439a-a8a0-8104ce5da419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:00.451601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a2b2e-51d8-439a-a8a0-8104ce5da419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:00.453046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a2b2e-51d8-439a-a8a0-8104ce5da419 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-297a2b2e-51d8-439a-a8a0-8104ce5da419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:16:00.464072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:00.466069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:00.468185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:00.472300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 478/948] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:00.472494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:00.578705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76645706-339e-4bdb-a3e7-63866f7b3647 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:00.608061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:00.615605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ad60d-5b04-4559-b0d8-009ebb4750ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:00.616213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ad60d-5b04-4559-b0d8-009ebb4750ce None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:00.616522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ad60d-5b04-4559-b0d8-009ebb4750ce None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:00.616792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ad60d-5b04-4559-b0d8-009ebb4750ce None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:00.617451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ad60d-5b04-4559-b0d8-009ebb4750ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:00.617754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ad60d-5b04-4559-b0d8-009ebb4750ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:00.619500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ad60d-5b04-4559-b0d8-009ebb4750ce None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:00.646672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 471/949] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:16:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:01.149240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fd7b-9296-4b43-adf6-51c610a64c84 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.149916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fd7b-9296-4b43-adf6-51c610a64c84 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.149916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fd7b-9296-4b43-adf6-51c610a64c84 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.151339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 479/950] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:01.156940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86bf2-a12a-491b-9cbe-5a621333e4e6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.157427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86bf2-a12a-491b-9cbe-5a621333e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.157582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86bf2-a12a-491b-9cbe-5a621333e4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.170324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564719e-9908-402c-a70e-9a080b1c3c19 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.170645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564719e-9908-402c-a70e-9a080b1c3c19 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.170875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564719e-9908-402c-a70e-9a080b1c3c19 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.172529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 480/951] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:16:01.177808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45223e1c-902e-42d2-bdf1-62ef46478b02 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.178057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0be86bf2-a12a-491b-9cbe-5a621333e4e6 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:01.178246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45223e1c-902e-42d2-bdf1-62ef46478b02 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.178401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45223e1c-902e-42d2-bdf1-62ef46478b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.179554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0be86bf2-a12a-491b-9cbe-5a621333e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:01.196005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-45223e1c-902e-42d2-bdf1-62ef46478b02 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:01.197228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-45223e1c-902e-42d2-bdf1-62ef46478b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:01.254501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 472/952] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:01.279662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 481/953] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:01.379176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8514-a9ed-4abb-a93e-9e510050689c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.379520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8514-a9ed-4abb-a93e-9e510050689c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.379768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8514-a9ed-4abb-a93e-9e510050689c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.381400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 473/954] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:01.386569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d211-18ae-4d98-94c7-c9fb8a098b12 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.386865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d211-18ae-4d98-94c7-c9fb8a098b12 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.387141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d211-18ae-4d98-94c7-c9fb8a098b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.406474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d262d211-18ae-4d98-94c7-c9fb8a098b12 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:01.407588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d262d211-18ae-4d98-94c7-c9fb8a098b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:01.473739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:01.483847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 482/955] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:01.548251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b8514-a9ed-4abb-a93e-9e510050689c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:01.549159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d211-18ae-4d98-94c7-c9fb8a098b12 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:01.665041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d211-18ae-4d98-94c7-c9fb8a098b12 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:01.680211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b8514-a9ed-4abb-a93e-9e510050689c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:01.700753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:01.701405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.701683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.701954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.713495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:01.718474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:01.719468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:01.720436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 483/956] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 21 05:16:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:01.721190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:01.732148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:01.732316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:01.732316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.732316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.732316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.732617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:01.732617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:01.740045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:01.741256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:01.742120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 474/957] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:01.749441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:01.785210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:01.836197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4ebb7-6cd9-4bc8-941b-897e10b9d644 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:01.859572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dc5e6-8d86-43b5-8f4a-2bf05abbf23c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:01.874838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:01.875475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.875759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.876036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.877322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:01.877627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:01.879024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:01.887605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 484/958] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 21 05:16:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:01.889235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:01.895917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:01.896562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:01.896846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:01.897121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:01.897751 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:01.898057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:01.899454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:01.908737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 475/959] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:16:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:01.908737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:01.962390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:02.009790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1325547-7f4a-42de-82c7-7fa5d3cb6f04 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.019498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65000-850f-405a-875d-f63f95d0e8eb None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.027981 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:02.048269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.049621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.050197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.050479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.051067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.052463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.055141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.055952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.056413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.056833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:02.061275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:02.062449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:02.063299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 485/960] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:16:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:02.064753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.074036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.075816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:02.090670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:02.091606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:02.092546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:02.092546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:02.092546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:02.092546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 476/961] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:02.097130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.178826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e60a1-7d2e-4d22-b81b-943dd0d133cc None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.201989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1eed8-f49a-41c0-9e9d-96d094e3809c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.203580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:02.212985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.213530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.213812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.214087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.214715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] RBAC: Adding query filter params (type=compute) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:02.215020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.216447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.232322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 486/962] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:16:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:02.232322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.253710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.254342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.254624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.254900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.255548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:02.255856 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.258341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.265275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 477/963] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:16:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:02.271162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.289753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:02.358788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b59d-5496-46a0-98f8-70b7cd7639af None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.390239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79f9ce-ff63-4f76-b365-329d5fc2d949 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.405173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.405805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.406089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.406494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.407161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:02.407567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.409561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.425505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 487/964] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:02.432293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.437881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.438500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.438781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.439089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.439723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:02.440025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.442389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.450486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 478/965] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:16:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:02.455887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.499853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:02.556776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f836d-9f66-4344-ac3e-3284ad5346a7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.560173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:02.597178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd7ba2-a85e-45d9-9896-6ac561f5a5a4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.597665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.598381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.598856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.599216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.608089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.609648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:16:02.622060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:02.623482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 05:16:02.624677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:02.628362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 488/966] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:16:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:02.631502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.646695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.647319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.647602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.647874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.649037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.650710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.688495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 479/967] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:16:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:16:02.755355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027993-b929-4a45-942e-f1fa90b0c230 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.803580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769b127-edec-4af0-bf24-52af0fe68425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:02.804215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b127-edec-4af0-bf24-52af0fe68425 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.804526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b127-edec-4af0-bf24-52af0fe68425 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.804793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b127-edec-4af0-bf24-52af0fe68425 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.805630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769b127-edec-4af0-bf24-52af0fe68425 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:02.805939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769b127-edec-4af0-bf24-52af0fe68425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:02.807452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769b127-edec-4af0-bf24-52af0fe68425 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:02.829117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 489/968] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 21 05:16:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:02.836065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:02.932156 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4d58-52f5-484d-bcd2-81ce7a3b5b63 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.932469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4d58-52f5-484d-bcd2-81ce7a3b5b63 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.932746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4d58-52f5-484d-bcd2-81ce7a3b5b63 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.934066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 490/969] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:16:02.939873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7074f-fcf4-437e-a19d-a1e5d58f8bed None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:02.940151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7074f-fcf4-437e-a19d-a1e5d58f8bed None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:02.940454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7074f-fcf4-437e-a19d-a1e5d58f8bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:02.950305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:02.963720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e9f7074f-fcf4-437e-a19d-a1e5d58f8bed None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:02.966007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e9f7074f-fcf4-437e-a19d-a1e5d58f8bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:02.968968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a83e0c-b8a8-437c-9c69-bb3c662a3752 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:02.981795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:03.013684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.014655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.015140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.015632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.059163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 491/970] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:03.092736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.094191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.181901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:03.200523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 480/971] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:03.206576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7074f-fcf4-437e-a19d-a1e5d58f8bed None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:03.307318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7074f-fcf4-437e-a19d-a1e5d58f8bed None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:03.332001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:03.343446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.344396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.344884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.345438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.356532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.358490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.368367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:03.376450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:03.378282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:03.379199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:03.379199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:03.379199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:03.382060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 492/972] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:03.387206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:03.446559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23109f-5474-4699-a667-08af50f235ca None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:03.483320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.484454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.484971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.485447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.486846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.488747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.505249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2827e-704d-4867-9d5f-930cfe9d531e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:03.506048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.sql.core [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 05:16:03.506048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 05:16:03.506048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [parameters: {'user_id': 'ea12b1f1756a4fd990ea7841ecbda6ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 05:16:03.506048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 21 05:16:03.514250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 05:16:03.515166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application yield resource Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application next(self.gen) Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise self.value Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application session.commit() Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 05:16:03.516175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.session.flush() Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application compat.raise_( Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 05:16:03.517154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 05:16:03.524753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application conn.query(q) Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application result.read() Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 05:16:03.527152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ea12b1f1756a4fd990ea7841ecbda6ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:03.529790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 21 05:16:03.532228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 481/973] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 21 05:16:03 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:03.534647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:03.566609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.567154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.567700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.567978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.568656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:03.569014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.570497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.585185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 493/974] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:03.590434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:03.644826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:03.656572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:03.667311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d623d9c-a032-4f26-b6e0-68bfdffe8aa5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:03.709257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e839725-db64-4814-aec5-227cfcd0a415 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:03.710164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.710903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.711288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.711828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.721536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.724261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:16:03.741741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:03.742840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 05:16:03.743788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:03.748255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 482/975] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:16:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:03.751325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:03.761925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.762989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.763279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.763556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.772677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.775318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:16:03.792605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:03.793535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:03.794434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:03.799489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 494/976] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:03.800626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:03.887158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66e37e-b55b-44d9-b430-931eb6b9de66 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:03.896768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:03.925608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.926283 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.926570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.926847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.927489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae97293-06d5-4d00-b024-6bbb4c76b903 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:03.927611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:03.927900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.929500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.949021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:03.964486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac5db6-0b42-44e9-9c86-9e797fbf9fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:03.965340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac5db6-0b42-44e9-9c86-9e797fbf9fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:03.965725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac5db6-0b42-44e9-9c86-9e797fbf9fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:03.966104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac5db6-0b42-44e9-9c86-9e797fbf9fa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:03.966975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac5db6-0b42-44e9-9c86-9e797fbf9fa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:03.967367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac5db6-0b42-44e9-9c86-9e797fbf9fa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:03.968875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac5db6-0b42-44e9-9c86-9e797fbf9fa5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:03.980816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 483/977] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 21 05:16:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:03.982876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 495/978] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:03.989756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:04.104644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e869-5d8d-4f00-874e-a34dada9326f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:04.142939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed7f34-4a6a-471c-b000-ec827e577548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:04.143479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7f34-4a6a-471c-b000-ec827e577548 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:04.143763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7f34-4a6a-471c-b000-ec827e577548 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:04.144039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7f34-4a6a-471c-b000-ec827e577548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:04.144809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed7f34-4a6a-471c-b000-ec827e577548 None admin] RBAC: Adding query filter params (role.id=50f2777d68ba446096ad0ff35589fe62, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=8c4901865c4748b7855435c801e37ea0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:04.145120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed7f34-4a6a-471c-b000-ec827e577548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:04.146592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed7f34-4a6a-471c-b000-ec827e577548 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:04.153637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 484/979] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:03 2022] GET /identity/v3/role_assignments?user.id=8c4901865c4748b7855435c801e37ea0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=50f2777d68ba446096ad0ff35589fe62 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:04.466191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc2c8-dca8-4a55-bff8-5aeba796a9df None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:04.466682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc2c8-dca8-4a55-bff8-5aeba796a9df None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:04.466682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc2c8-dca8-4a55-bff8-5aeba796a9df None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:04.468104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 496/980] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:04.473257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70a9f-d301-4a1d-8bff-6aecd363c5a6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:04.473633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70a9f-d301-4a1d-8bff-6aecd363c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:04.473826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70a9f-d301-4a1d-8bff-6aecd363c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:04.491816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bee70a9f-d301-4a1d-8bff-6aecd363c5a6 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:04.493350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bee70a9f-d301-4a1d-8bff-6aecd363c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:04.518846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:04.565000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 485/981] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:04.829640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc2c8-dca8-4a55-bff8-5aeba796a9df None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:04.943008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc2c8-dca8-4a55-bff8-5aeba796a9df None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:04.976177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ded9-5734-40b5-8780-58d04f67a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:04.976814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ded9-5734-40b5-8780-58d04f67a63a None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:04.977094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ded9-5734-40b5-8780-58d04f67a63a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:04.977367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ded9-5734-40b5-8780-58d04f67a63a None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:04.978025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0ded9-5734-40b5-8780-58d04f67a63a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:04.979379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0ded9-5734-40b5-8780-58d04f67a63a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:04.995734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 497/982] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:16:04 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:16:05.029636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f68b-df85-4dad-8d6c-508fc74c05b0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:05.029948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f68b-df85-4dad-8d6c-508fc74c05b0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:05.030205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f68b-df85-4dad-8d6c-508fc74c05b0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:05.031775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 486/983] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:05.037516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d9409-c735-439c-b5c7-879cf5135536 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:05.037814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d9409-c735-439c-b5c7-879cf5135536 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:05.038086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d9409-c735-439c-b5c7-879cf5135536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:05.059100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e19d9409-c735-439c-b5c7-879cf5135536 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:05.060472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e19d9409-c735-439c-b5c7-879cf5135536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:05.102164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:05.147348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 498/984] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:05.414980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37f68b-df85-4dad-8d6c-508fc74c05b0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:05.520736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37f68b-df85-4dad-8d6c-508fc74c05b0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:05.555833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:05.556495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:05.556781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:05.557049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:05.557775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:05.559257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:05.569194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:05.570183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:05.571061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:05.578287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 487/985] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:16:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:05.578425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d9409-c735-439c-b5c7-879cf5135536 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:05.674448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d9409-c735-439c-b5c7-879cf5135536 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:05.708142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:05.708790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:05.709072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:05.709344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:05.709977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:05.710278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:05.711647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:05.720483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 499/986] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:16:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:05.722793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:05.749122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:05.824718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d0db4-38ca-4164-94f0-d5270ba2f8b4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:05.867482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:05.868094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:05.868398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:05.868668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:05.869289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:05.869587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:05.870978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:05.881971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 488/987] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:16:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:05.883538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:05.914635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:05.983745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761f49-e2ba-48a9-943a-798bd4d93943 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:06.018811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49514f01-a16e-46a6-9c2b-0b1e1ee6b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:06.019421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49514f01-a16e-46a6-9c2b-0b1e1ee6b8ac None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:06.019697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49514f01-a16e-46a6-9c2b-0b1e1ee6b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:06.019967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49514f01-a16e-46a6-9c2b-0b1e1ee6b8ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:06.020689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49514f01-a16e-46a6-9c2b-0b1e1ee6b8ac None admin] RBAC: Adding query filter params (interface=admin, service_id=799bdd97de714682b9b68979428d1819, region_id=RegionOne) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:06.020994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49514f01-a16e-46a6-9c2b-0b1e1ee6b8ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:06.022367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49514f01-a16e-46a6-9c2b-0b1e1ee6b8ac None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:06.027371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 500/988] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Sep 21 05:16:05 2022] GET /identity/v3/endpoints?service_id=799bdd97de714682b9b68979428d1819&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:06.033359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:06.125761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:06.139437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e23e1-47b7-4108-8c01-3bd7ac7f9f2a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:06.172714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31382f-def1-4b72-988f-2c6aabe9905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:06.173464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31382f-def1-4b72-988f-2c6aabe9905c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:06.173669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31382f-def1-4b72-988f-2c6aabe9905c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:06.173885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31382f-def1-4b72-988f-2c6aabe9905c None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:06.174474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31382f-def1-4b72-988f-2c6aabe9905c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:06.175829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31382f-def1-4b72-988f-2c6aabe9905c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:06.182102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 489/989] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:16:06 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:16:06.351360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dce72-1135-4351-9012-5d41ac21462f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:06.351668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dce72-1135-4351-9012-5d41ac21462f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:06.351926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dce72-1135-4351-9012-5d41ac21462f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:06.353428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 501/990] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:06.358639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45b76-9575-42d8-ad58-0729079baf2e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:06.358925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45b76-9575-42d8-ad58-0729079baf2e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:06.359199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45b76-9575-42d8-ad58-0729079baf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:06.378614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6ac45b76-9575-42d8-ad58-0729079baf2e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:06.379793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6ac45b76-9575-42d8-ad58-0729079baf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:06.445679 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 490/991] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:06.711512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dce72-1135-4351-9012-5d41ac21462f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:06.805225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:06.814380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dce72-1135-4351-9012-5d41ac21462f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:06.851760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:06.852426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:06.852716 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:06.852983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:06.853803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:06.856571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:06.867462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:06.868495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:06.869342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:06.872396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 502/992] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 21 05:16:06 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:06.875110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45b76-9575-42d8-ad58-0729079baf2e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:06.955591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:06.975218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45b76-9575-42d8-ad58-0729079baf2e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:07.009153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c6242-687e-48a4-81b1-df17e661c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:07.009763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6242-687e-48a4-81b1-df17e661c4cc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:07.010042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6242-687e-48a4-81b1-df17e661c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:07.010316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6242-687e-48a4-81b1-df17e661c4cc None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:07.010943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c6242-687e-48a4-81b1-df17e661c4cc None admin] RBAC: Adding query filter params (name=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:07.011245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c6242-687e-48a4-81b1-df17e661c4cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:07.012768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c6242-687e-48a4-81b1-df17e661c4cc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:07.017615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 491/993] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:07.023158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:07.129536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a7a8b-5e6d-444f-a6aa-8da47ac341b5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:07.162882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd77618-e5ca-44f2-943b-9ca720db3adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:07.163486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd77618-e5ca-44f2-943b-9ca720db3adb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:07.163767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd77618-e5ca-44f2-943b-9ca720db3adb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:07.164040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd77618-e5ca-44f2-943b-9ca720db3adb None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:07.164698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd77618-e5ca-44f2-943b-9ca720db3adb None admin] RBAC: Adding query filter params (type=image) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:07.164999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd77618-e5ca-44f2-943b-9ca720db3adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:07.166356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd77618-e5ca-44f2-943b-9ca720db3adb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:07.170887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 503/994] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:07.176834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e481-62a5-4b19-9513-593419a501f2 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:07.177115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e481-62a5-4b19-9513-593419a501f2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:07.177394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e481-62a5-4b19-9513-593419a501f2 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:07.178916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 492/995] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:07.184597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18633c6b-21ae-40b4-ba0e-8996d707c878 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:07.184884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18633c6b-21ae-40b4-ba0e-8996d707c878 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:07.185167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18633c6b-21ae-40b4-ba0e-8996d707c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:07.205419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-18633c6b-21ae-40b4-ba0e-8996d707c878 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:07.206656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-18633c6b-21ae-40b4-ba0e-8996d707c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:07.225878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:07.282363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 504/996] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:07.551546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e481-62a5-4b19-9513-593419a501f2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:07.657238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e481-62a5-4b19-9513-593419a501f2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:07.691308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:07.691940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:07.692222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:07.692520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:07.693098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:07.694470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:07.703267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:07.704269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:07.705986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:07.708773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 493/997] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:07.710796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18633c6b-21ae-40b4-ba0e-8996d707c878 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:07.812840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18633c6b-21ae-40b4-ba0e-8996d707c878 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:07.851399 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:07.852016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:07.852357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:07.852601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:07.853235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:07.853572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:07.856887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:07.866524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 505/998] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:16:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:07.867627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:07.880900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:07.972424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411f7a8-39a9-4f82-bb65-a143adc94080 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:08.006650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:08.007258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:08.007539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:08.007813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:08.008529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:08.008836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:08.010206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:08.019505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 494/999] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:16:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:08.020829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:08.042077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:08.125121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6088-819b-4e4b-9812-7fbed7c86c7b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:08.158891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fd3e-f921-4284-b155-3c01a57cdb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:08.159500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd3e-f921-4284-b155-3c01a57cdb64 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:08.159785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd3e-f921-4284-b155-3c01a57cdb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:08.160064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd3e-f921-4284-b155-3c01a57cdb64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:08.160849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd3e-f921-4284-b155-3c01a57cdb64 None admin] RBAC: Adding query filter params (interface=public, service_id=36f86c6f806d42fe9d842e91223e3667, region_id=RegionOne) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:08.161195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd3e-f921-4284-b155-3c01a57cdb64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:08.162554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd3e-f921-4284-b155-3c01a57cdb64 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:08.167665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 506/1000] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:16:08 2022] GET /identity/v3/endpoints?service_id=36f86c6f806d42fe9d842e91223e3667&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:08.173134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:08.252122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:08.278388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a0e6-6a8c-406f-9fa2-0a55ff4abccd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:08.312422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4deb2-70be-4d25-99ed-56fb8b58ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:08.313050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4deb2-70be-4d25-99ed-56fb8b58ad7b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:08.313336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4deb2-70be-4d25-99ed-56fb8b58ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:08.313616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4deb2-70be-4d25-99ed-56fb8b58ad7b None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:08.314256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4deb2-70be-4d25-99ed-56fb8b58ad7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:08.315627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4deb2-70be-4d25-99ed-56fb8b58ad7b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:08.328302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 495/1001] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:16:08 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:16:08.340218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c656-e2eb-4e6e-b0d2-ccd22299a565 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:08.340546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c656-e2eb-4e6e-b0d2-ccd22299a565 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:08.340822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c656-e2eb-4e6e-b0d2-ccd22299a565 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:08.342177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 507/1002] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:08.348651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96bc33-f0ac-4da7-87c3-f50ec2dd1f02 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:08.348937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96bc33-f0ac-4da7-87c3-f50ec2dd1f02 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:08.349213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96bc33-f0ac-4da7-87c3-f50ec2dd1f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:08.369828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3a96bc33-f0ac-4da7-87c3-f50ec2dd1f02 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:08.371046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3a96bc33-f0ac-4da7-87c3-f50ec2dd1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:08.467522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 496/1003] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:08.739569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2c656-e2eb-4e6e-b0d2-ccd22299a565 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:08.837061 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:08.862721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2c656-e2eb-4e6e-b0d2-ccd22299a565 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:08.898256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:08.898891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:08.899174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:08.899447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:08.900032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:08.901428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:08.911015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:08.912023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:08.917322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 508/1004] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 21 05:16:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:08.919367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96bc33-f0ac-4da7-87c3-f50ec2dd1f02 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:08.987074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:09.026755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96bc33-f0ac-4da7-87c3-f50ec2dd1f02 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:09.061378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:09.061992 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:09.062276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:09.062548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:09.063171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:09.063476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:09.065498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:09.077012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 497/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:16:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:09.078420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:09.183615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e4c22-3030-44eb-b2a1-3481349444d0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:09.221559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e4a10-433b-4fbd-af92-b22db8b5b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:09.222202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4a10-433b-4fbd-af92-b22db8b5b329 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:09.222477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4a10-433b-4fbd-af92-b22db8b5b329 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:09.222744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4a10-433b-4fbd-af92-b22db8b5b329 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:09.223593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e4a10-433b-4fbd-af92-b22db8b5b329 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:09.223887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e4a10-433b-4fbd-af92-b22db8b5b329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:09.225395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e4a10-433b-4fbd-af92-b22db8b5b329 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:09.231159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 509/1006] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 21 05:16:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:09.236678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:09.321562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bfb9b-5e60-4f25-927b-84c65733c4e2 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:09.321768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bfb9b-5e60-4f25-927b-84c65733c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:09.322018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bfb9b-5e60-4f25-927b-84c65733c4e2 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:09.325644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 510/1007] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:16:09.331079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b50d0-2ca4-48c1-98c2-48f3207566e1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:09.331369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b50d0-2ca4-48c1-98c2-48f3207566e1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:09.331647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b50d0-2ca4-48c1-98c2-48f3207566e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:09.340815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082ec89-1407-438e-bede-89007abd3447 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:09.350153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e98b50d0-2ca4-48c1-98c2-48f3207566e1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:09.351342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e98b50d0-2ca4-48c1-98c2-48f3207566e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:09.353324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:09.371524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:09.378206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:09.378842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:09.379125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:09.379397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:09.380068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:09.381466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:09.400438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 498/1008] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:16:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:16:09.441009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 511/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:09.708618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:09.808802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71851dd-6d27-45a8-815d-f4e05e765d00 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:09.845933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb96dc-6344-44f0-9bbb-abc3af391517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:09.846561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb96dc-6344-44f0-9bbb-abc3af391517 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:09.846846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb96dc-6344-44f0-9bbb-abc3af391517 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:09.847121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb96dc-6344-44f0-9bbb-abc3af391517 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:09.847788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb96dc-6344-44f0-9bbb-abc3af391517 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:09.849217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb96dc-6344-44f0-9bbb-abc3af391517 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:09.868312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 499/1010] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:16:09 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:16:10.515073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87874-9f67-4b69-b8c5-50554bbeaf1c None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:10.515597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87874-9f67-4b69-b8c5-50554bbeaf1c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:10.515597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87874-9f67-4b69-b8c5-50554bbeaf1c None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:10.517139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 512/1011] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:10.522087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949da21-2376-4196-908c-87d5fea00e68 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:10.522488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949da21-2376-4196-908c-87d5fea00e68 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:10.522645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949da21-2376-4196-908c-87d5fea00e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:10.541769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5949da21-2376-4196-908c-87d5fea00e68 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:10.542939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5949da21-2376-4196-908c-87d5fea00e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:10.591387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:10.620513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 500/1012] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:10 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:10.893801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87874-9f67-4b69-b8c5-50554bbeaf1c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:10.993274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87874-9f67-4b69-b8c5-50554bbeaf1c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:11.026800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:11.027423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:11.027698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:11.028008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:11.028632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:11.029983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:11.031722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:11.041659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:11.042678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:11.043516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 513/1013] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:11.050335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949da21-2376-4196-908c-87d5fea00e68 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:11.149528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949da21-2376-4196-908c-87d5fea00e68 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:11.183202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:11.183814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:11.184092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:11.184418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:11.185019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:11.185319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:11.186684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:11.192143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 501/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:16:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:11.197534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:11.297359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a5d17-ef0c-4364-a741-3ed5be57784b None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:11.330325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453500d7-7bd6-425c-891f-ff2f084e81f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:11.330925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453500d7-7bd6-425c-891f-ff2f084e81f7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:11.331211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453500d7-7bd6-425c-891f-ff2f084e81f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:11.331480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453500d7-7bd6-425c-891f-ff2f084e81f7 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:11.332099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453500d7-7bd6-425c-891f-ff2f084e81f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:11.332429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453500d7-7bd6-425c-891f-ff2f084e81f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:11.333787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453500d7-7bd6-425c-891f-ff2f084e81f7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:11.343600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 514/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 21 05:16:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:11.344855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:11.387334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:11.443035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1c55e-a083-4b80-97a2-e240a2388482 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:11.481472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04139e6-6793-4ad0-9378-57a9c0104d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:11.482102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04139e6-6793-4ad0-9378-57a9c0104d2f None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:11.482379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04139e6-6793-4ad0-9378-57a9c0104d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:11.482649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04139e6-6793-4ad0-9378-57a9c0104d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:11.483331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04139e6-6793-4ad0-9378-57a9c0104d2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:11.484785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04139e6-6793-4ad0-9378-57a9c0104d2f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:11.512523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 502/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:16:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:16:11.609192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f58be4-c833-4bdb-acb4-c6d061572441 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:11.609741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f58be4-c833-4bdb-acb4-c6d061572441 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:11.609741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f58be4-c833-4bdb-acb4-c6d061572441 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:11.611788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 515/1017] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:11.617361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce648b96-9c02-46b9-91d6-d0dde8d7ede1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:11.617839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce648b96-9c02-46b9-91d6-d0dde8d7ede1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:11.617936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce648b96-9c02-46b9-91d6-d0dde8d7ede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:11.637811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ce648b96-9c02-46b9-91d6-d0dde8d7ede1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:11.639028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ce648b96-9c02-46b9-91d6-d0dde8d7ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:11.717804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 503/1018] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:11.988653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f58be4-c833-4bdb-acb4-c6d061572441 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:12.053187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:12.084786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5a84-115a-4caf-becd-0c320449dbac None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:12.085078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5a84-115a-4caf-becd-0c320449dbac None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:12.085357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5a84-115a-4caf-becd-0c320449dbac None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:12.086703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 504/1019] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:16:12.091588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae8b4-00c2-40a5-a475-f9a23556a02f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:12.091874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae8b4-00c2-40a5-a475-f9a23556a02f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:12.092158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae8b4-00c2-40a5-a475-f9a23556a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:12.097574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f58be4-c833-4bdb-acb4-c6d061572441 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:12.112976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-670ae8b4-00c2-40a5-a475-f9a23556a02f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:12.114162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-670ae8b4-00c2-40a5-a475-f9a23556a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:12.132594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:12.135711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:12.136894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:12.137178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:12.137611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:12.139062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:12.141390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:12.147827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 516/1020] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:12.148902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:12.185273 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 505/1021] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:12.253991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a44b6-b52f-4c60-a937-57b9a19749f8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:12.281470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:12.288922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:12.289538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:12.289822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:12.290099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:12.290748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:12.292176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:12.319753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 517/1022] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:16:12 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:16:12.462932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae8b4-00c2-40a5-a475-f9a23556a02f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:12.567841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae8b4-00c2-40a5-a475-f9a23556a02f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:12.601981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:12.602607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:12.602883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:12.603152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] PATH_INFO: `/v3/services/image` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:12.603726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:12.605106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:12.614100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:12.615109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:12.616410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 506/1023] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 21 05:16:12 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:12.621079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:12.739311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15d55d-18d1-48c8-97e3-4501a5651d69 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:12.775275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:12.775897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:12.776181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:12.776482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:12.777116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] RBAC: Adding query filter params (name=image) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:12.777423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:12.778790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:12.788809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 518/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:12.790065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:12.812035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:12.904012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde29ac-9cb4-42a4-92b5-bd6cddcc5cdc None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:12.937795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:12.938401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:12.938699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:12.938968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:12.939586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] RBAC: Adding query filter params (type=image) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:12.939884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:12.941268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:12.950954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 507/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:12.951906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:12.998025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:13.061218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2904e5-ed75-4cab-95c3-fc00fc162c08 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:13.107821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb7147-2b43-443f-9448-1a85cb1ae2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:13.108817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb7147-2b43-443f-9448-1a85cb1ae2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:13.109189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb7147-2b43-443f-9448-1a85cb1ae2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:13.109602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb7147-2b43-443f-9448-1a85cb1ae2d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:13.110728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb7147-2b43-443f-9448-1a85cb1ae2d5 None admin] RBAC: Adding query filter params (interface=public, service_id=b4a9a692337e4c0eb4896e9888f53388, region_id=RegionOne) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:13.111209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb7147-2b43-443f-9448-1a85cb1ae2d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:13.112994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb7147-2b43-443f-9448-1a85cb1ae2d5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:13.125055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 519/1026] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:16:12 2022] GET /identity/v3/endpoints?service_id=b4a9a692337e4c0eb4896e9888f53388&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:13.126329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:13.209133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:13.228828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bc30-1559-409e-8d53-aee7e153e5db None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:13.264301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265eb2e-f031-4dc1-b07a-79081df85e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:13.264937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265eb2e-f031-4dc1-b07a-79081df85e58 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:13.265213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265eb2e-f031-4dc1-b07a-79081df85e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:13.265481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265eb2e-f031-4dc1-b07a-79081df85e58 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:13.266080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265eb2e-f031-4dc1-b07a-79081df85e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:13.267967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265eb2e-f031-4dc1-b07a-79081df85e58 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:13.274673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 508/1027] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:16:13 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:16:13.831942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0035-1067-4441-98ca-ee34d04e9884 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:13.832486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0035-1067-4441-98ca-ee34d04e9884 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:13.832563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0035-1067-4441-98ca-ee34d04e9884 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:13.833989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 520/1028] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:13.839138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9cbe0-33bc-45fb-a9d3-80a3181c9782 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:13.839577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9cbe0-33bc-45fb-a9d3-80a3181c9782 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:13.839724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9cbe0-33bc-45fb-a9d3-80a3181c9782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:13.858137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f9c9cbe0-33bc-45fb-a9d3-80a3181c9782 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:13.859307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f9c9cbe0-33bc-45fb-a9d3-80a3181c9782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:13.925928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 509/1029] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:14.197257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e0035-1067-4441-98ca-ee34d04e9884 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:14.300541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e0035-1067-4441-98ca-ee34d04e9884 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:14.310919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:14.334375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:14.334999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:14.335280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:14.335551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:14.345946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:14.350658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:14.351583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:14.352485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 521/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 21 05:16:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:14.358199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9cbe0-33bc-45fb-a9d3-80a3181c9782 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:14.436894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:14.462712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9cbe0-33bc-45fb-a9d3-80a3181c9782 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:14.500066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122c7d3-c69e-4f37-b866-f603f65e544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:14.500723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122c7d3-c69e-4f37-b866-f603f65e544f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:14.501000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122c7d3-c69e-4f37-b866-f603f65e544f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:14.501301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122c7d3-c69e-4f37-b866-f603f65e544f None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:14.501969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122c7d3-c69e-4f37-b866-f603f65e544f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:14.502269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122c7d3-c69e-4f37-b866-f603f65e544f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:14.503629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122c7d3-c69e-4f37-b866-f603f65e544f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:14.516361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 510/1031] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 21 05:16:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:14.517835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:14.543329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09387-671c-4cc0-923c-8a4afe755ef3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:14.543612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09387-671c-4cc0-923c-8a4afe755ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:14.543885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09387-671c-4cc0-923c-8a4afe755ef3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:14.545248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 511/1032] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:16:14.551192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba3d97-bae4-4695-8aa5-0f704e513294 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:14.551534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba3d97-bae4-4695-8aa5-0f704e513294 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:14.551816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba3d97-bae4-4695-8aa5-0f704e513294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:14.570674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b9ba3d97-bae4-4695-8aa5-0f704e513294 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:14.571860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9ba3d97-bae4-4695-8aa5-0f704e513294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:14.628927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd277-9861-4ce9-986e-51fe9448d7eb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:14.641628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 512/1033] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:14.663812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:14.664482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:14.664765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:14.665038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:14.675074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:14.676558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:14.691533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:14.692681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:14.693662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:14.693662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:14.693662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:14.694201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 522/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:14.698282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba3d97-bae4-4695-8aa5-0f704e513294 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:14.765602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:14.800093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba3d97-bae4-4695-8aa5-0f704e513294 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:14.833189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:14.833805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:14.834084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:14.834358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:14.834998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:14.835298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:14.836691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:14.852959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 513/1035] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:14.854165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:14.883669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:14.917949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:14.965788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c7db-fc25-4cf8-a21e-1a07d7e73150 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.000828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.001953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.002235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.002532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.010255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.011699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:16:15.024183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:15.025304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:15.026277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 523/1036] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:16:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:15.030717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:15.043602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41797-692f-4879-a59f-891e1c200703 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.071100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:15.082658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.083586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.083892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.084167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.085303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.086730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:15.088310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 514/1037] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:15.094048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:15.124694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:15.145706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f3c45-d3b2-4fb2-816f-7356dca1af8a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.181105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.181712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.181994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.182271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.182995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:15.183674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.184876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:15.195278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffdc43-9a1a-42db-918c-b13fea2c089f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.209700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 524/1038] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:16:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:15.210719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:15.233105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e83e5-7f4f-44a4-b7ec-09f63dc6dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.233709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e83e5-7f4f-44a4-b7ec-09f63dc6dc44 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.233989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e83e5-7f4f-44a4-b7ec-09f63dc6dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.234261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e83e5-7f4f-44a4-b7ec-09f63dc6dc44 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.234896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e83e5-7f4f-44a4-b7ec-09f63dc6dc44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.236380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e83e5-7f4f-44a4-b7ec-09f63dc6dc44 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:15.259411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 515/1039] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:16:15 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:16:15.327052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f8a69-b6c3-44d7-921e-2817bfb66a24 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.368977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.369935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.370413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.370871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.383407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:15.447955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.449444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:15.462541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14b2eb-7b08-4d1c-abdc-06856604edcd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.462901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14b2eb-7b08-4d1c-abdc-06856604edcd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.463187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14b2eb-7b08-4d1c-abdc-06856604edcd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.464824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 516/1040] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:16:15.470596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991098d-aae8-402b-8e5a-2b505cb117ec None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.470975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991098d-aae8-402b-8e5a-2b505cb117ec None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.471324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991098d-aae8-402b-8e5a-2b505cb117ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.491191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2991098d-aae8-402b-8e5a-2b505cb117ec None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:15.492667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2991098d-aae8-402b-8e5a-2b505cb117ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:15.549807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:15.562008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 525/1041] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:15 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:15.567647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:15.573737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 517/1042] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:15.610671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:15.669709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1b62-afc3-400f-9146-5c7dc2bbc7f1 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.704002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.705209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.705485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.705753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.716096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.717570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:15.731762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:15.732925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:15.733819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:15.733819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:15.733819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:15.736582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 526/1043] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:15.738668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991098d-aae8-402b-8e5a-2b505cb117ec None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:15.838459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991098d-aae8-402b-8e5a-2b505cb117ec None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.838876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:15.876912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.877533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.877780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.878055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.878702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:15.878995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.880407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:15.892798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 518/1044] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:15.898224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:15.943643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:15.944138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:15.953664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53109318-91fc-4858-9846-3b44b00fd5f8 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:15.988096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:15.988879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:15.989156 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:15.989426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] PATH_INFO: `/v3/services/image` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:15.990299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:15.991675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:16.000970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:16.002478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:16.003402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 527/1045] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 21 05:16:15 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:16.008391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:16.009719 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751266f8-7099-4180-bc98-8b4d806e27e3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:16.044520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:16.045162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:16.045447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:16.045721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:16.053207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:16.054655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:16:16.066529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:16.067462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:16.068391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 519/1046] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:16.073277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:16.122145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc9f56-d3bb-46f5-8da6-7ebd97cbde29 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:16.158418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:16.158948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:16.159230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:16.159506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:16.160161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] RBAC: Adding query filter params (name=image) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:16.160470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:16.161936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:16.167224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 528/1047] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:16.174062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:16.183700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e536f5-1f80-4b13-b446-2d99d48e0716 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:16.185246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:16.201679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:16.220233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:16.220991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:16.221328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:16.221607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:16.222307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:16.222616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:16.224054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:16.241875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 520/1048] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:16.242906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:16.296190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54136b8-0ccf-4883-9cd7-5458c111f39d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:16.333217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:16.333821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:16.334106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:16.334379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:16.335005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] RBAC: Adding query filter params (type=image) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:16.335310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:16.336710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:16.342942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 529/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:16.348224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:16.348471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989484d-9aef-4ee6-a926-f3b229b13e68 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:16.386527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb216460-a5ef-4d5a-b4f3-e20c1d7c6739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:16.387129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb216460-a5ef-4d5a-b4f3-e20c1d7c6739 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:16.387408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb216460-a5ef-4d5a-b4f3-e20c1d7c6739 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:16.387683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb216460-a5ef-4d5a-b4f3-e20c1d7c6739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:16.388430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb216460-a5ef-4d5a-b4f3-e20c1d7c6739 None admin] RBAC: Adding query filter params (role.id=50f2777d68ba446096ad0ff35589fe62, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=c83d5e7a41404bacb2b4d18daf040aa0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:16.388739 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb216460-a5ef-4d5a-b4f3-e20c1d7c6739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:16.390162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb216460-a5ef-4d5a-b4f3-e20c1d7c6739 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:16.404310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 521/1050] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:16 2022] GET /identity/v3/role_assignments?user.id=c83d5e7a41404bacb2b4d18daf040aa0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=50f2777d68ba446096ad0ff35589fe62 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:16.448149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:16.467193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc303f7d-5271-4266-99ce-92bb7aeef780 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:16.504714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c005c-7886-444c-a0bb-b6ffa864b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:16.505337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c005c-7886-444c-a0bb-b6ffa864b652 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:16.505616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c005c-7886-444c-a0bb-b6ffa864b652 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:16.505888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c005c-7886-444c-a0bb-b6ffa864b652 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:16.506567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c005c-7886-444c-a0bb-b6ffa864b652 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:16.507949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c005c-7886-444c-a0bb-b6ffa864b652 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:16.530545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 530/1051] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:16:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:16:17.489719 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6ca6-6ac5-4a1b-9d6b-55bbf6a566e3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:17.490242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6ca6-6ac5-4a1b-9d6b-55bbf6a566e3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:17.490242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6ca6-6ac5-4a1b-9d6b-55bbf6a566e3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:17.491635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 522/1052] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:17.496938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc105-fab4-4d1e-a842-95890e371cc7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:17.497354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc105-fab4-4d1e-a842-95890e371cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:17.497744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc105-fab4-4d1e-a842-95890e371cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:17.516350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4f5bc105-fab4-4d1e-a842-95890e371cc7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:17.517515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4f5bc105-fab4-4d1e-a842-95890e371cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:17.588858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 531/1053] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:17.856820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6ca6-6ac5-4a1b-9d6b-55bbf6a566e3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:17.885255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:17.960197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6ca6-6ac5-4a1b-9d6b-55bbf6a566e3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:17.994396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:17.995020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:17.995295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:17.995564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.005856 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:18.010536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:18.011462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:18.013057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 523/1054] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:16:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:18.017918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc105-fab4-4d1e-a842-95890e371cc7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:18.083449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:18.122733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc105-fab4-4d1e-a842-95890e371cc7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:18.155616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:18.156225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.156547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.156820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.157997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:18.158299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:18.159667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:18.167807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 532/1055] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:16:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:18.174122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:18.260249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:18.275968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b615-4163-482e-98a2-79f2be7c0277 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:18.310306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849fb7b-9718-46f4-88ad-daea4e7cdb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:18.310939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fb7b-9718-46f4-88ad-daea4e7cdb61 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.311219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fb7b-9718-46f4-88ad-daea4e7cdb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.311491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fb7b-9718-46f4-88ad-daea4e7cdb61 None admin] PATH_INFO: `/v3/users/4e2a34a5fc1b42ce8f83c2598e131309` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.324574 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849fb7b-9718-46f4-88ad-daea4e7cdb61 None admin] RBAC: Authorizing `identity:get_user(user_id=4e2a34a5fc1b42ce8f83c2598e131309)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:18.326003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849fb7b-9718-46f4-88ad-daea4e7cdb61 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:18.327865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 524/1056] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:18 2022] GET /identity/v3/users/4e2a34a5fc1b42ce8f83c2598e131309 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:18.333885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:18.438133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a40e82-6db3-4ed6-a316-ca508fd0ca31 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:18.468685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:18.478708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18b05a-183b-4c2a-af3d-0fb886ef9485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:18.479319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b05a-183b-4c2a-af3d-0fb886ef9485 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.479591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b05a-183b-4c2a-af3d-0fb886ef9485 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.479866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b05a-183b-4c2a-af3d-0fb886ef9485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.548060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18b05a-183b-4c2a-af3d-0fb886ef9485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:18.549533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18b05a-183b-4c2a-af3d-0fb886ef9485 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:18.564000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d851b-df28-4d48-9e18-44747fd4e385 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.564523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d851b-df28-4d48-9e18-44747fd4e385 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.564523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d851b-df28-4d48-9e18-44747fd4e385 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.565841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 525/1057] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:18.570938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdde77d-0007-4d8d-8320-939d3395d317 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.571230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdde77d-0007-4d8d-8320-939d3395d317 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.571522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdde77d-0007-4d8d-8320-939d3395d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.589940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3cdde77d-0007-4d8d-8320-939d3395d317 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:18.591132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3cdde77d-0007-4d8d-8320-939d3395d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:18.665420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 526/1058] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:18.665865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 533/1059] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:18.671612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdde77d-0007-4d8d-8320-939d3395d317 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:18.722106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e10b-bf4a-44ec-9574-2316f764bcc2 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.722597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e10b-bf4a-44ec-9574-2316f764bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.723010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e10b-bf4a-44ec-9574-2316f764bcc2 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.724597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 534/1060] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:18.729244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91c778-dd13-4a42-8d67-330e1e1b2072 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.729594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91c778-dd13-4a42-8d67-330e1e1b2072 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.729935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91c778-dd13-4a42-8d67-330e1e1b2072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.748692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6c91c778-dd13-4a42-8d67-330e1e1b2072 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:18.749023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:18.750012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6c91c778-dd13-4a42-8d67-330e1e1b2072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:18.774379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:18.777387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdde77d-0007-4d8d-8320-939d3395d317 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:18.812365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:18.813258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.814027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.814307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.815413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] RBAC: Authorizing `identity:get_project(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:18.816877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:18.818488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 527/1061] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:18 2022] GET /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:18.824481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:18.827521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 535/1062] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:18.925765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef3f6-5d9b-401d-a0d6-33ba8467e7d4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:18.934354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91c778-dd13-4a42-8d67-330e1e1b2072 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:18.964065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:18.964691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:18.964965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:18.965230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:18.965932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8, user.id=4e2a34a5fc1b42ce8f83c2598e131309) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:18.966240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:18.967653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:18.973433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 528/1063] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:18 2022] GET /identity/v3/role_assignments?user.id=4e2a34a5fc1b42ce8f83c2598e131309&scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:19.045217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91c778-dd13-4a42-8d67-330e1e1b2072 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.084081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.084767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.085049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.085323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.093973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.099622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:19.104009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:19.105121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:19.106106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:19.107294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:19.112799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 536/1064] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 21 05:16:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:19.114081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.136259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:19.204998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a80c-30c8-461a-a167-f9a6b9cbc4c4 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.226389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57587a-7c26-4f6e-8e5e-83d58317dc56 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.239159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.239769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.240073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.240382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.261796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.262594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.262715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.262933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.263589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:19.263883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.265270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.274072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 537/1065] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:19.279610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.312301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.314372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.322549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:19.370262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:19.390967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea0170-9903-4a43-a239-c9ac3a78cf76 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.427892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.427892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.427892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.427892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.428330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 529/1066] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 05:16:19.430888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.438134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.440172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:19.454975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:19.456120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:19.457384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:19.457384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:19.457384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:19.457384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 538/1067] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:19.461674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.541339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611b964-40d3-4a63-8771-cdad496e54c5 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.549410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:19.569216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d9e5-603f-426f-b898-c6e76c129263 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.580196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.580934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.581218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.581495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.592085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.593789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.599007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:19.605214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.605829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.606107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.606380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.607018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:19.607318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.608697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:19.611266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:19.612181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:19.613141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:19.613141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:19.613141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:19.617450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 530/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:19.618005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.625596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 539/1069] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:19.628206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.729650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af711c44-7a1d-448a-86f3-1dd99358a750 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.732714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a24dc-d038-4011-b806-fa79a094e7a4 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.764044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.764684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.764964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.765235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.765885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:19.766193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.768164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.771654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.772527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.773020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.773485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.780152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 531/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:19.789655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.791189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:16:19.805039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:19.806043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:16:19.807000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:19.808658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 540/1071] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:19.812108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:19.833623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:19.934121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5829-d6f2-4719-96bd-1bd58b4379b9 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:19.973230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:19.973847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:19.974136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:19.974410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:19.975134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:19.975438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:19.976897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:19.995158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 532/1072] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:16:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:20.002157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:20.056135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:20.105477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258189a-ae5e-4e47-b65d-2a9c937df951 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:20.139121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:20.139752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:20.140031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:20.140327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:20.150430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:20.151863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:20.166001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:20.167051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:20.168121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:20.168121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:20.168121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:20.168121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 541/1073] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:20.173465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:20.247917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:20.270867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1a598-ed12-4be1-b967-f91d36f1b8f6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:20.304204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:20.304835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:20.305118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:20.305392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:20.306025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:20.306382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:20.307692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:20.318590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 533/1074] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:20.324018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:20.420571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8834-7be0-409f-941e-e6677019ca08 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:20.423352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:20.454235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:20.454872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:20.455138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:20.455413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:20.461931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:20.463364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:16:20.474869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:20.475722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:20.476658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 542/1075] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:20.481695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:20.579705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ba3c-8976-4ffb-9d6e-640631e02277 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:20.612328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42856897-a0d8-4f67-a7dc-1cbb293ccf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:20.612969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856897-a0d8-4f67-a7dc-1cbb293ccf0a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:20.613200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856897-a0d8-4f67-a7dc-1cbb293ccf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:20.613473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856897-a0d8-4f67-a7dc-1cbb293ccf0a None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:20.614154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42856897-a0d8-4f67-a7dc-1cbb293ccf0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:20.614460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42856897-a0d8-4f67-a7dc-1cbb293ccf0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:20.615885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42856897-a0d8-4f67-a7dc-1cbb293ccf0a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:20.618278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:20.628588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 534/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:20.634595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:20.730223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fb474-44c5-496b-9af6-09d004303990 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:20.762123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7a98f-4f70-4d04-b92e-5938d7ade6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:20.762781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7a98f-4f70-4d04-b92e-5938d7ade6bd None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:20.763062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7a98f-4f70-4d04-b92e-5938d7ade6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:20.763395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7a98f-4f70-4d04-b92e-5938d7ade6bd None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/c83d5e7a41404bacb2b4d18daf040aa0/roles/50f2777d68ba446096ad0ff35589fe62` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:20.765537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7a98f-4f70-4d04-b92e-5938d7ade6bd None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=c83d5e7a41404bacb2b4d18daf040aa0, role_id=50f2777d68ba446096ad0ff35589fe62)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:20.767505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7a98f-4f70-4d04-b92e-5938d7ade6bd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:20.780461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 543/1077] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:16:20 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/c83d5e7a41404bacb2b4d18daf040aa0/roles/50f2777d68ba446096ad0ff35589fe62 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:16:21.136704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dced5-2246-45ae-863c-871ff9275651 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:21.136914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dced5-2246-45ae-863c-871ff9275651 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:21.137190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dced5-2246-45ae-863c-871ff9275651 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:21.138527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 535/1078] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:21.144491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d929cb-242d-4f9d-8670-a30a6c1e2194 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:21.144787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d929cb-242d-4f9d-8670-a30a6c1e2194 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:21.145069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d929cb-242d-4f9d-8670-a30a6c1e2194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:21.165338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c7d929cb-242d-4f9d-8670-a30a6c1e2194 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:21.166546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c7d929cb-242d-4f9d-8670-a30a6c1e2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:21.186005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:21.236672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 544/1079] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:21.504034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dced5-2246-45ae-863c-871ff9275651 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:21.611987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dced5-2246-45ae-863c-871ff9275651 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:21.648755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:21.649370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:21.649641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:21.649906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:21.662134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:21.667084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:21.668110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:21.669017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 536/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:16:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:21.674852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d929cb-242d-4f9d-8670-a30a6c1e2194 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:21.774217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d929cb-242d-4f9d-8670-a30a6c1e2194 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:21.807285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:21.807887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:21.808164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:21.808471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:21.809139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:21.809445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:21.810805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:21.818693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 545/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:21.824495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:21.883369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:21.926895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd729855-1f8e-4958-a161-3c88b805e141 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:21.958566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:21.959187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:21.959467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:21.959742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] PATH_INFO: `/v3/users/4e2a34a5fc1b42ce8f83c2598e131309` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:21.960866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] RBAC: Authorizing `identity:get_user(user_id=4e2a34a5fc1b42ce8f83c2598e131309)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:21.962287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:21.963838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 537/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:21 2022] GET /identity/v3/users/4e2a34a5fc1b42ce8f83c2598e131309 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:21.970091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:21.989756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:22.071333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e65e3-6338-4b5a-bb44-9e4da4dbedea None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:22.104172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c17d4f-7ea1-47eb-9028-238e5af0f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:22.104822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17d4f-7ea1-47eb-9028-238e5af0f12d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:22.105095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17d4f-7ea1-47eb-9028-238e5af0f12d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:22.105364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17d4f-7ea1-47eb-9028-238e5af0f12d None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:22.106461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c17d4f-7ea1-47eb-9028-238e5af0f12d None admin] RBAC: Authorizing `identity:get_project(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:22.107880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c17d4f-7ea1-47eb-9028-238e5af0f12d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:22.109533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 546/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:21 2022] GET /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:22.115361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:22.212191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfa358-c081-4bbc-bf5a-ddd610902b5b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:22.234460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:22.246006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28695fec-1330-45c7-95e7-4991369f4e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:22.246649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695fec-1330-45c7-95e7-4991369f4e07 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:22.246926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695fec-1330-45c7-95e7-4991369f4e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:22.247197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695fec-1330-45c7-95e7-4991369f4e07 None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8/users/4e2a34a5fc1b42ce8f83c2598e131309/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:22.249339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695fec-1330-45c7-95e7-4991369f4e07 None admin] RBAC: Authorizing `identity:create_grant(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8, user_id=4e2a34a5fc1b42ce8f83c2598e131309, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:22.250842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695fec-1330-45c7-95e7-4991369f4e07 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:22.263031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 538/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:16:22 2022] PUT /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8/users/4e2a34a5fc1b42ce8f83c2598e131309/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:16:22.970466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8289f2-8502-4fee-b629-01d996ec1217 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:22.971011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8289f2-8502-4fee-b629-01d996ec1217 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:22.971011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8289f2-8502-4fee-b629-01d996ec1217 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:22.972434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 547/1085] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:22.977663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4b7f0-c8db-418f-a0c0-08c0910b6f69 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:22.978055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4b7f0-c8db-418f-a0c0-08c0910b6f69 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:22.978342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4b7f0-c8db-418f-a0c0-08c0910b6f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:22.996969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d0b4b7f0-c8db-418f-a0c0-08c0910b6f69 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:22.998430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d0b4b7f0-c8db-418f-a0c0-08c0910b6f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:23.062453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 539/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:23.330484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8289f2-8502-4fee-b629-01d996ec1217 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:23.413525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:23.431119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8289f2-8502-4fee-b629-01d996ec1217 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:23.463669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:23.464306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:23.464595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:23.464870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:23.475787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:23.480531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:23.481594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:23.482514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 548/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 21 05:16:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:23.488247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4b7f0-c8db-418f-a0c0-08c0910b6f69 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:23.589510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4b7f0-c8db-418f-a0c0-08c0910b6f69 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:23.603656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:23.624170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:23.624804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:23.625081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:23.625351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:23.626005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:23.626306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:23.627663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:23.635156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 540/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 21 05:16:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:23.641093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:23.740040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54450-f3cc-4ab8-80ea-9a5282f032d3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:23.772170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:23.772808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:23.773086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:23.773356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:23.783992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:23.785460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:23.787824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:23.799782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:23.800959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:23.802444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:23.802444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:23.802444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:23.802444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 549/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:23.806551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:23.906982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d8d4f-f7a6-46d2-ad3b-1ba4881f99ef None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:23.940455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:23.941058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:23.941336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:23.941604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:23.942235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:23.942537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:23.943897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:23.956102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 541/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:23.961738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.058146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283136ce-d316-44f5-8526-5fe6bbd7c932 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:24.090615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:24.091234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.091512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.091786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.098951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:24.100413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:16:24.111729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:24.117683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:24.118894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 550/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 21 05:16:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:24.119655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.154490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:24.218113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bba6b2-afc3-49a1-ab7c-573defbf150c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:24.252715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acdd66-787f-4041-96cf-0cf862990686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:24.253323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acdd66-787f-4041-96cf-0cf862990686 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.253603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acdd66-787f-4041-96cf-0cf862990686 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.253873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acdd66-787f-4041-96cf-0cf862990686 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.254591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acdd66-787f-4041-96cf-0cf862990686 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:24.254894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acdd66-787f-4041-96cf-0cf862990686 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:24.256367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acdd66-787f-4041-96cf-0cf862990686 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:24.281453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 542/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 21 05:16:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:24.282528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.338051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:24.382856 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a810a-313e-4eb3-983f-3dc7755cab49 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.383052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8df91-d62c-46eb-a0cc-ef59e1ccc291 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:24.383156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a810a-313e-4eb3-983f-3dc7755cab49 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.383326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a810a-313e-4eb3-983f-3dc7755cab49 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.384681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 543/1093] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:16:24.389664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957e6d1-f397-4850-943b-842ef29a23c2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.390019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957e6d1-f397-4850-943b-842ef29a23c2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.390303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957e6d1-f397-4850-943b-842ef29a23c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.407721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c957e6d1-f397-4850-943b-842ef29a23c2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:24.408943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c957e6d1-f397-4850-943b-842ef29a23c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:24.417782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:24.418391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.418670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.418969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.474431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 544/1094] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:24.487452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:24.488935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:24.541730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:24.585645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 551/1095] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:24.591388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957e6d1-f397-4850-943b-842ef29a23c2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.615846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:24.690887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957e6d1-f397-4850-943b-842ef29a23c2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:24.723737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:24.724392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.724673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.724946 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.734692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:24.736724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:24.744980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:24.751212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:24.752368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:16:24.753434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:24.753434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:16:24.753434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:24.753434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 545/1096] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:24.757708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.831942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:24.843763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94a00-1ceb-44fa-a92a-d5f8461a3c07 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:24.859126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176c10-4486-482e-9cb7-f8d95b6b5b1e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:24.878976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:24.879600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.879876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.880145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.890453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:24.892196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:24.892817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:24.893099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:24.893374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:24.894007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:24.894310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:24.895121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:24.896200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:24.897121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:24.897767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:24.897837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 552/1097] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:16:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:24.901991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.911563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 546/1098] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:24.917015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:24.920103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:25.001581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203f883-7d72-40db-8a07-470dde08d951 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.012214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb40c-e746-4356-a2a3-d26deeeeab83 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.035762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.036392 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.036672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.036942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.037596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:25.037900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.039256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.046972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 553/1099] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:16:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:25.049281 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.049998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.050340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.050673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.053363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:25.053625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:25.058669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.060293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:16:25.071233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:25.072267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:25.073275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 547/1100] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:16:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:16:25.077951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:25.134675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:25.156426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11305fd8-fb61-46d8-bed6-366b5ad52a9d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.175341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ada2-2116-43b5-94cf-66b67e0322cd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.189773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.190397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.190672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.190942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] PATH_INFO: `/v3/users/4e2a34a5fc1b42ce8f83c2598e131309` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.192062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] RBAC: Authorizing `identity:get_user(user_id=4e2a34a5fc1b42ce8f83c2598e131309)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.193520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.195076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 554/1101] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:25 2022] GET /identity/v3/users/4e2a34a5fc1b42ce8f83c2598e131309 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:25.200773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:25.208146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.208780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.209063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.209334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.210023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:25.210330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.211752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.222827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 548/1102] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:25.228720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:25.283210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:25.297273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b53f-fd8c-430f-8da2-026060e1e757 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.325811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620bbea-b092-4664-9cc9-5059b8d6b4ac None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.330708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.331312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.331593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.331867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.347347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:25.358407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.359001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.359285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.359559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.360823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] RBAC: Adding query filter params (role.id=50f2777d68ba446096ad0ff35589fe62, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=c83d5e7a41404bacb2b4d18daf040aa0) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:25.361126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.362542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.368102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 549/1103] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:25 2022] GET /identity/v3/role_assignments?user.id=c83d5e7a41404bacb2b4d18daf040aa0&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=50f2777d68ba446096ad0ff35589fe62 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:16:25.402629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.404105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.507047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 555/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:25.513085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:25.614591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f02e0-b7fc-4e34-aba6-1cfdaa8d20e7 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.634673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:25.649642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1541de1-f112-4b63-9d04-3e7b986cb414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.650270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541de1-f112-4b63-9d04-3e7b986cb414 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.650548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541de1-f112-4b63-9d04-3e7b986cb414 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.650820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541de1-f112-4b63-9d04-3e7b986cb414 None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.651924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1541de1-f112-4b63-9d04-3e7b986cb414 None admin] RBAC: Authorizing `identity:get_project(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.653421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1541de1-f112-4b63-9d04-3e7b986cb414 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.655197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 550/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:25 2022] GET /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:25.662087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:25.709630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:25.764164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f010-e31b-4c8c-b95c-6d44d2180603 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:25.797541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae8e66-0e30-4fa6-99f6-6e9db6a013ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:25.798905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8e66-0e30-4fa6-99f6-6e9db6a013ad None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:25.799185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8e66-0e30-4fa6-99f6-6e9db6a013ad None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:25.799458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8e66-0e30-4fa6-99f6-6e9db6a013ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:25.800189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae8e66-0e30-4fa6-99f6-6e9db6a013ad None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8, user.id=4e2a34a5fc1b42ce8f83c2598e131309) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:25.800526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae8e66-0e30-4fa6-99f6-6e9db6a013ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:25.801953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae8e66-0e30-4fa6-99f6-6e9db6a013ad None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:25.808022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 556/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:25 2022] GET /identity/v3/role_assignments?user.id=4e2a34a5fc1b42ce8f83c2598e131309&scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:27.967139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2da8-f6f8-420b-b9dd-90f0da624cab None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:27.967668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2da8-f6f8-420b-b9dd-90f0da624cab None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:27.967668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2da8-f6f8-420b-b9dd-90f0da624cab None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:27.969056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 551/1107] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:27.974138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f75077-ae39-4818-93d8-834d299769fa None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:27.974565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f75077-ae39-4818-93d8-834d299769fa None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:27.974696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f75077-ae39-4818-93d8-834d299769fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:27.992252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-36f75077-ae39-4818-93d8-834d299769fa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:27.993464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-36f75077-ae39-4818-93d8-834d299769fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:28.057270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 557/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:28.331976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae2da8-f6f8-420b-b9dd-90f0da624cab None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:28.429064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae2da8-f6f8-420b-b9dd-90f0da624cab None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:28.459998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8f4e-7243-495a-b9f8-ffea3b69ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:28.460629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8f4e-7243-495a-b9f8-ffea3b69ac88 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:28.460911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8f4e-7243-495a-b9f8-ffea3b69ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:28.461180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8f4e-7243-495a-b9f8-ffea3b69ac88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:28.462256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f8f4e-7243-495a-b9f8-ffea3b69ac88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:28.463674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f8f4e-7243-495a-b9f8-ffea3b69ac88 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:28.465213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 552/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:28.472114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f75077-ae39-4818-93d8-834d299769fa None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:28.514266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:28.575948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f75077-ae39-4818-93d8-834d299769fa None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:28.608525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc550d82-e558-4cc4-ae5f-fec91860839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:28.609067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc550d82-e558-4cc4-ae5f-fec91860839d None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:28.609346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc550d82-e558-4cc4-ae5f-fec91860839d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:28.609615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc550d82-e558-4cc4-ae5f-fec91860839d None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:28.610908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc550d82-e558-4cc4-ae5f-fec91860839d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:28.612359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc550d82-e558-4cc4-ae5f-fec91860839d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:28.632683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 558/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:16:28 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:16:30.801199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc72ba-7d66-47ae-b65b-b7088d54602a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:30.801725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc72ba-7d66-47ae-b65b-b7088d54602a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:30.801725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc72ba-7d66-47ae-b65b-b7088d54602a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:30.803054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 553/1111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:30.808161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e12c5b-1e28-44ac-986e-0ad64a29ecbe None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:30.808566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e12c5b-1e28-44ac-986e-0ad64a29ecbe None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:30.808754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e12c5b-1e28-44ac-986e-0ad64a29ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:30.826550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-34e12c5b-1e28-44ac-986e-0ad64a29ecbe None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:30.827732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-34e12c5b-1e28-44ac-986e-0ad64a29ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:30.892433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 559/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:31.162887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc72ba-7d66-47ae-b65b-b7088d54602a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:31.217888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:31.262325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc72ba-7d66-47ae-b65b-b7088d54602a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:31.293714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:31.294323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:31.294601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:31.294870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] PATH_INFO: `/v3/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:31.296227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] RBAC: Authorizing `identity:get_role(role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:31.298112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:31.299396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 554/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:31 2022] GET /identity/v3/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:31.305092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e12c5b-1e28-44ac-986e-0ad64a29ecbe None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:31.330926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:31.402314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e12c5b-1e28-44ac-986e-0ad64a29ecbe None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:31.435291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:31.435858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:31.436141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:31.436447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] PATH_INFO: `/v3/users/b8c484e39ce24a5cb8fe356538f392f6` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:31.448942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c484e39ce24a5cb8fe356538f392f6)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:31.450388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:31.451956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 560/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:31 2022] GET /identity/v3/users/b8c484e39ce24a5cb8fe356538f392f6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:31.457573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:31.555245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4f7f-b452-4e23-b131-d7bc96ea63ad None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:31.579040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:31.589660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:31.590263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:31.590540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:31.590810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:31.655044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:31.656505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:31.750584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 555/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:31.756468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:31.836754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:31.853300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6aef3-69f1-429e-a29e-5c3964ff9113 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:31.893007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80244-7ffd-4005-88a8-7ffa6626ab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:31.893638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80244-7ffd-4005-88a8-7ffa6626ab07 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:31.893919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80244-7ffd-4005-88a8-7ffa6626ab07 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:31.894196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80244-7ffd-4005-88a8-7ffa6626ab07 None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:31.895304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80244-7ffd-4005-88a8-7ffa6626ab07 None admin] RBAC: Authorizing `identity:get_project(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:31.896781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80244-7ffd-4005-88a8-7ffa6626ab07 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:31.898407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 561/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:31 2022] GET /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:31.904769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:31.928858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:32.001647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce0922-368b-4856-a7f4-b69641d94685 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:32.037173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0c5d-1e12-4c69-b629-299236be35db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:32.037767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0c5d-1e12-4c69-b629-299236be35db None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:32.038046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0c5d-1e12-4c69-b629-299236be35db None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:32.038319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0c5d-1e12-4c69-b629-299236be35db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:32.039031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b0c5d-1e12-4c69-b629-299236be35db None admin] RBAC: Adding query filter params (role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8, user.id=b8c484e39ce24a5cb8fe356538f392f6) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:32.039341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b0c5d-1e12-4c69-b629-299236be35db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:32.040802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b0c5d-1e12-4c69-b629-299236be35db None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:32.045932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 556/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:31 2022] GET /identity/v3/role_assignments?user.id=b8c484e39ce24a5cb8fe356538f392f6&scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:34.135299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafbd17-0298-43fb-b7f0-df1fbf8a6a8c None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:34.135895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafbd17-0298-43fb-b7f0-df1fbf8a6a8c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:34.135895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafbd17-0298-43fb-b7f0-df1fbf8a6a8c None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:34.137124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 562/1118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:34.142440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1f034-9e70-4130-9029-29fdec14d8ca None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:34.142835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1f034-9e70-4130-9029-29fdec14d8ca None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:34.142994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1f034-9e70-4130-9029-29fdec14d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:34.160818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b2e1f034-9e70-4130-9029-29fdec14d8ca None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:34.162007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b2e1f034-9e70-4130-9029-29fdec14d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:34.226247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 557/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:34.498218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafbd17-0298-43fb-b7f0-df1fbf8a6a8c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:34.593081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafbd17-0298-43fb-b7f0-df1fbf8a6a8c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:34.626337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:34.626939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:34.627215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:34.627485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] PATH_INFO: `/v3/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:34.628878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] RBAC: Authorizing `identity:get_role(role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:34.630227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:34.631490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 563/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:34 2022] GET /identity/v3/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:34.637146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1f034-9e70-4130-9029-29fdec14d8ca None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:34.654717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:34.732016 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1f034-9e70-4130-9029-29fdec14d8ca None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:34.764764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:34.765333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:34.765615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:34.765889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] PATH_INFO: `/v3/users/b8c484e39ce24a5cb8fe356538f392f6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:34.767027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c484e39ce24a5cb8fe356538f392f6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:34.768488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:34.770023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 558/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:34 2022] GET /identity/v3/users/b8c484e39ce24a5cb8fe356538f392f6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:34.775644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:34.796953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:34.872222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702bd09-94e2-4ed4-838d-df9ff7a60356 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:34.904824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34574670-7434-4688-9958-450d1eb9a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:34.905442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34574670-7434-4688-9958-450d1eb9a276 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:34.905719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34574670-7434-4688-9958-450d1eb9a276 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:34.905990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34574670-7434-4688-9958-450d1eb9a276 None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:34.907623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34574670-7434-4688-9958-450d1eb9a276 None admin] RBAC: Authorizing `identity:get_project(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:34.909072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34574670-7434-4688-9958-450d1eb9a276 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:34.910658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 564/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:34 2022] GET /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:34.916652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:34.996654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:35.011495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7052-78af-4ea8-ad93-5720405a2943 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:35.044889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac674bc-745e-467c-b246-f5831ba298f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:35.045466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac674bc-745e-467c-b246-f5831ba298f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:35.045741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac674bc-745e-467c-b246-f5831ba298f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:35.046010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac674bc-745e-467c-b246-f5831ba298f7 None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8/users/b8c484e39ce24a5cb8fe356538f392f6/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:35.048107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac674bc-745e-467c-b246-f5831ba298f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8, user_id=b8c484e39ce24a5cb8fe356538f392f6, role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:35.049541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac674bc-745e-467c-b246-f5831ba298f7 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:35.061408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 559/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:16:34 2022] PUT /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8/users/b8c484e39ce24a5cb8fe356538f392f6/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:16:37.135400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa08d7-4d02-4d49-a981-9ec3a40e3b1e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:37.135951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa08d7-4d02-4d49-a981-9ec3a40e3b1e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:37.135951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa08d7-4d02-4d49-a981-9ec3a40e3b1e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:37.137223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 565/1124] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:37.142856 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f256b5-0f6f-4936-bc5a-a24a32079ffd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:37.143237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f256b5-0f6f-4936-bc5a-a24a32079ffd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:37.143396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f256b5-0f6f-4936-bc5a-a24a32079ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:37.161615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-52f256b5-0f6f-4936-bc5a-a24a32079ffd None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:37.162789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-52f256b5-0f6f-4936-bc5a-a24a32079ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:37.227969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 560/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:37.491391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa08d7-4d02-4d49-a981-9ec3a40e3b1e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:37.576155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:37.589654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa08d7-4d02-4d49-a981-9ec3a40e3b1e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:37.621827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:37.622446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:37.622977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:37.623249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] PATH_INFO: `/v3/roles/2cf85c2c61ba48a49a5b011c7239d024` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:37.624657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] RBAC: Authorizing `identity:get_role(role_id=2cf85c2c61ba48a49a5b011c7239d024)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:37.626515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:37.627816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 566/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:37 2022] GET /identity/v3/roles/2cf85c2c61ba48a49a5b011c7239d024 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:37.633614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f256b5-0f6f-4936-bc5a-a24a32079ffd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:37.706468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:37.728921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f256b5-0f6f-4936-bc5a-a24a32079ffd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:37.761494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:37.762050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:37.762330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:37.762601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] PATH_INFO: `/v3/users/b8c484e39ce24a5cb8fe356538f392f6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:37.763690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] RBAC: Authorizing `identity:get_user(user_id=b8c484e39ce24a5cb8fe356538f392f6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:37.765139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:37.767275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 561/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:37 2022] GET /identity/v3/users/b8c484e39ce24a5cb8fe356538f392f6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:37.772890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:37.868126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cec19-4545-482b-b60e-d0e1b119ed74 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:37.901426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:37.902016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:37.902294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:37.902565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:37.925736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:37.966474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:37.967898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:38.059776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 567/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:38.066272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:38.160579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c195b-09a3-402c-9ae4-2f675930b26a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:38.192821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd864eb-0195-4c49-990b-13593410c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:38.193428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd864eb-0195-4c49-990b-13593410c795 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:38.193708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd864eb-0195-4c49-990b-13593410c795 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:38.193982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd864eb-0195-4c49-990b-13593410c795 None admin] PATH_INFO: `/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:38.195077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd864eb-0195-4c49-990b-13593410c795 None admin] RBAC: Authorizing `identity:get_project(project_id=124e0e88b9b44d3e8fe123ba6c2ba3f8)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:38.196514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd864eb-0195-4c49-990b-13593410c795 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:38.198102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 562/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:38 2022] GET /identity/v3/projects/124e0e88b9b44d3e8fe123ba6c2ba3f8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:38.203954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:38.257150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:38.299866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f441-1a52-41f0-b3ce-7693856d07fd None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:38.331680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e9dc6-a7de-4fd6-8d89-3aca151186f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:38.332272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e9dc6-a7de-4fd6-8d89-3aca151186f9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:38.332694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e9dc6-a7de-4fd6-8d89-3aca151186f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:38.332971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e9dc6-a7de-4fd6-8d89-3aca151186f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:38.333684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e9dc6-a7de-4fd6-8d89-3aca151186f9 None admin] RBAC: Adding query filter params (role.id=2cf85c2c61ba48a49a5b011c7239d024, scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8, user.id=b8c484e39ce24a5cb8fe356538f392f6) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:38.333987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e9dc6-a7de-4fd6-8d89-3aca151186f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:38.335401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e9dc6-a7de-4fd6-8d89-3aca151186f9 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:38.340862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 568/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:38 2022] GET /identity/v3/role_assignments?user.id=b8c484e39ce24a5cb8fe356538f392f6&scope.project.id=124e0e88b9b44d3e8fe123ba6c2ba3f8&role.id=2cf85c2c61ba48a49a5b011c7239d024 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:40.491323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a2d2-737f-4369-a3db-16debe992ecb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:40.491873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a2d2-737f-4369-a3db-16debe992ecb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:40.491873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a2d2-737f-4369-a3db-16debe992ecb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:40.493235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 563/1131] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:40.498593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac7a2-f764-45ae-b128-8cff379b1991 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:40.499024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac7a2-f764-45ae-b128-8cff379b1991 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:40.499114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac7a2-f764-45ae-b128-8cff379b1991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:40.516811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-058ac7a2-f764-45ae-b128-8cff379b1991 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:40.517986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-058ac7a2-f764-45ae-b128-8cff379b1991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:40.581406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 569/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:40.845352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a2d2-737f-4369-a3db-16debe992ecb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:40.859907 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:40.943748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a2d2-737f-4369-a3db-16debe992ecb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:40.976469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47ae1a-a243-454a-8284-cd2a690515a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:40.977076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47ae1a-a243-454a-8284-cd2a690515a8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:40.977351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47ae1a-a243-454a-8284-cd2a690515a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:40.977623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47ae1a-a243-454a-8284-cd2a690515a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:40.978704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47ae1a-a243-454a-8284-cd2a690515a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:40.980116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47ae1a-a243-454a-8284-cd2a690515a8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:40.981679 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 564/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:40.987473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ac7a2-f764-45ae-b128-8cff379b1991 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:41.034643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:41.082582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ac7a2-f764-45ae-b128-8cff379b1991 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:41.115186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a8c58-d170-4c9c-af17-3de1a3a982fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:41.115724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a8c58-d170-4c9c-af17-3de1a3a982fb None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:41.116005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a8c58-d170-4c9c-af17-3de1a3a982fb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:41.116303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a8c58-d170-4c9c-af17-3de1a3a982fb None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:41.116951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a8c58-d170-4c9c-af17-3de1a3a982fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:41.118371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a8c58-d170-4c9c-af17-3de1a3a982fb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:41.144053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 570/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:16:40 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:16:43.293187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49227b-3c9f-4ea1-be39-81d84627f65d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:43.293733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49227b-3c9f-4ea1-be39-81d84627f65d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:43.293733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49227b-3c9f-4ea1-be39-81d84627f65d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:43.294986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 565/1135] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:43.300197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842b4ac-e510-46cc-a185-a22568526f77 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:43.300645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842b4ac-e510-46cc-a185-a22568526f77 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:43.300786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842b4ac-e510-46cc-a185-a22568526f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:43.318493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6842b4ac-e510-46cc-a185-a22568526f77 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:43.319666 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6842b4ac-e510-46cc-a185-a22568526f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:43.383491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 571/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:43.660217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49227b-3c9f-4ea1-be39-81d84627f65d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:43.738105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:43.758056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49227b-3c9f-4ea1-be39-81d84627f65d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:43.790199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeacfa-0a65-428b-966c-e39d0c5e521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:43.790809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeacfa-0a65-428b-966c-e39d0c5e521e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:43.791090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeacfa-0a65-428b-966c-e39d0c5e521e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:43.791363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeacfa-0a65-428b-966c-e39d0c5e521e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:43.792481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeacfa-0a65-428b-966c-e39d0c5e521e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:43.793904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeacfa-0a65-428b-966c-e39d0c5e521e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:43.795439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 566/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:43.801691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842b4ac-e510-46cc-a185-a22568526f77 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:43.831398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:43.900847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842b4ac-e510-46cc-a185-a22568526f77 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:43.935318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fc050-2a0b-40e0-a2de-46f04e4cfc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:43.935843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc050-2a0b-40e0-a2de-46f04e4cfc48 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:43.936122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc050-2a0b-40e0-a2de-46f04e4cfc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:43.936439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc050-2a0b-40e0-a2de-46f04e4cfc48 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:43.937086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fc050-2a0b-40e0-a2de-46f04e4cfc48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:43.939165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fc050-2a0b-40e0-a2de-46f04e4cfc48 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:43.960063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 572/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:16:43 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:16:46.154763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3140b8-939c-477b-9d6b-aa6e886c838a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:46.155251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3140b8-939c-477b-9d6b-aa6e886c838a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:46.155251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3140b8-939c-477b-9d6b-aa6e886c838a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:46.157215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 567/1139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:46.162346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead0dc4-5074-4c8a-9f67-96fac2225b53 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:46.162712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead0dc4-5074-4c8a-9f67-96fac2225b53 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:46.162906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead0dc4-5074-4c8a-9f67-96fac2225b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:46.180775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-aead0dc4-5074-4c8a-9f67-96fac2225b53 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:46.181962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-aead0dc4-5074-4c8a-9f67-96fac2225b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:46.245807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 573/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:46.513601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3140b8-939c-477b-9d6b-aa6e886c838a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:46.617201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3140b8-939c-477b-9d6b-aa6e886c838a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:46.652847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:46.653471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:46.653754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:46.654030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:46.663815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:46.668578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:46.669631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:46.670792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 568/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:46.675744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead0dc4-5074-4c8a-9f67-96fac2225b53 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:46.693937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:46.773454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead0dc4-5074-4c8a-9f67-96fac2225b53 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:46.805959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:46.806556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:46.806833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:46.807102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:46.807755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:46.808055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:46.809446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:46.817688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 574/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:46.823613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:46.834512 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:46.920519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c7a4a-75ee-4568-9b01-5803ac6246e6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:46.957479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:46.958112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:46.958396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:46.958674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] PATH_INFO: `/v3/users/60ada0ca0a3a48048f89dc42519007a2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:46.974031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] RBAC: Authorizing `identity:get_user(user_id=60ada0ca0a3a48048f89dc42519007a2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:46.975493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:46.977190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 569/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:46 2022] GET /identity/v3/users/60ada0ca0a3a48048f89dc42519007a2 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:46.982983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:47.060508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:47.079728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a1e6f-1534-44b5-a112-18cdc851e862 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:47.111712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:47.112335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:47.112619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:47.112891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:47.176867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:47.178347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:47.252286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:47.270869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 575/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:47.276754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:47.340088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:47.376490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3950-873c-4a3d-82a6-fe89a035076a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:47.409118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c850296-5706-409d-8522-dc5d680b8c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:47.409737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850296-5706-409d-8522-dc5d680b8c0d None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:47.410017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850296-5706-409d-8522-dc5d680b8c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:47.410294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850296-5706-409d-8522-dc5d680b8c0d None admin] PATH_INFO: `/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:47.411397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c850296-5706-409d-8522-dc5d680b8c0d None admin] RBAC: Authorizing `identity:get_project(project_id=2fe50481e8c34b9cbd0a15a9d5c245ab)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:47.412858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c850296-5706-409d-8522-dc5d680b8c0d None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:47.414468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 570/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:47 2022] GET /identity/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:47.420650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:47.514194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391407-c961-43f3-9af9-2b548d55aab6 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:47.547457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2dd2f-44ad-4b80-839b-a11ce91eb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:47.548039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2dd2f-44ad-4b80-839b-a11ce91eb01e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:47.548346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2dd2f-44ad-4b80-839b-a11ce91eb01e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:47.548622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2dd2f-44ad-4b80-839b-a11ce91eb01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:47.549330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2dd2f-44ad-4b80-839b-a11ce91eb01e None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=2fe50481e8c34b9cbd0a15a9d5c245ab, user.id=60ada0ca0a3a48048f89dc42519007a2) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:47.549636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2dd2f-44ad-4b80-839b-a11ce91eb01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:47.551041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2dd2f-44ad-4b80-839b-a11ce91eb01e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:47.556102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 576/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:47 2022] GET /identity/v3/role_assignments?user.id=60ada0ca0a3a48048f89dc42519007a2&scope.project.id=2fe50481e8c34b9cbd0a15a9d5c245ab&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:49.661210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f25d9-2a8e-4cb7-a521-321143420ae3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:49.663729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f25d9-2a8e-4cb7-a521-321143420ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:49.663729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f25d9-2a8e-4cb7-a521-321143420ae3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:49.663729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 571/1147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:49.668487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8922-1d5c-4318-b967-966ac94619d9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:49.668910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8922-1d5c-4318-b967-966ac94619d9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:49.669039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8922-1d5c-4318-b967-966ac94619d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:49.686722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ba8f8922-1d5c-4318-b967-966ac94619d9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:49.688422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ba8f8922-1d5c-4318-b967-966ac94619d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:49.726714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:49.753950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 577/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:50.018758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f25d9-2a8e-4cb7-a521-321143420ae3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:50.114901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f25d9-2a8e-4cb7-a521-321143420ae3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:50.147319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:50.147924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:50.148200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:50.148499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:50.150253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:50.159867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:50.164571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:50.165708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:50.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 572/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:50.171532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f8922-1d5c-4318-b967-966ac94619d9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:50.264264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f8922-1d5c-4318-b967-966ac94619d9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:50.296339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:50.297432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:50.297708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:50.297979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:50.298630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:50.298928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:50.300303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:50.307853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 578/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:50.313372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:50.409999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3411f-7895-4858-88d2-ecf0d91155be None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:50.442293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:50.442904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:50.443180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:50.443448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] PATH_INFO: `/v3/users/60ada0ca0a3a48048f89dc42519007a2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:50.444559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] RBAC: Authorizing `identity:get_user(user_id=60ada0ca0a3a48048f89dc42519007a2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:50.445975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:50.447499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 573/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:50 2022] GET /identity/v3/users/60ada0ca0a3a48048f89dc42519007a2 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:50.453236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:50.487755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:50.548878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1f156-a6dd-404c-952e-406af06103fb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:50.580165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b9c43-bfbc-499c-ac2d-6424fc8b6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:50.580803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9c43-bfbc-499c-ac2d-6424fc8b6fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:50.581106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9c43-bfbc-499c-ac2d-6424fc8b6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:50.581376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9c43-bfbc-499c-ac2d-6424fc8b6fc2 None admin] PATH_INFO: `/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:50.582465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b9c43-bfbc-499c-ac2d-6424fc8b6fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=2fe50481e8c34b9cbd0a15a9d5c245ab)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:50.583873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b9c43-bfbc-499c-ac2d-6424fc8b6fc2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:50.585484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 579/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:50 2022] GET /identity/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:50.591193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:50.650289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:50.687018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea789d63-3172-4068-aa09-1021a272fc6b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:50.720239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a533f-ce30-4465-b671-3927107995be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:50.720914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a533f-ce30-4465-b671-3927107995be None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:50.721194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a533f-ce30-4465-b671-3927107995be None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:50.721468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a533f-ce30-4465-b671-3927107995be None admin] PATH_INFO: `/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab/users/60ada0ca0a3a48048f89dc42519007a2/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:50.723326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a533f-ce30-4465-b671-3927107995be None admin] RBAC: Authorizing `identity:create_grant(project_id=2fe50481e8c34b9cbd0a15a9d5c245ab, user_id=60ada0ca0a3a48048f89dc42519007a2, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:50.724786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a533f-ce30-4465-b671-3927107995be None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:50.737922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 574/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:16:50 2022] PUT /identity/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab/users/60ada0ca0a3a48048f89dc42519007a2/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:16:52.841434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6360d-da8d-4e90-a782-079f449f9d0b None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:52.842070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6360d-da8d-4e90-a782-079f449f9d0b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:52.842070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6360d-da8d-4e90-a782-079f449f9d0b None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:52.844022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 580/1154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:52.849064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbc70d-40f6-4cbe-9cad-9153ca7a568c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:52.849461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbc70d-40f6-4cbe-9cad-9153ca7a568c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:52.849600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbc70d-40f6-4cbe-9cad-9153ca7a568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:52.867266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-40dbc70d-40f6-4cbe-9cad-9153ca7a568c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:52.868461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-40dbc70d-40f6-4cbe-9cad-9153ca7a568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:52.931533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 575/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:16:53.197321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6360d-da8d-4e90-a782-079f449f9d0b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:53.293811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6360d-da8d-4e90-a782-079f449f9d0b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:53.296011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:53.325990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:53.326596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:53.326872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:53.327141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:53.337115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:16:53.341817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:53.342970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:16:53.344570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 581/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:53.349378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbc70d-40f6-4cbe-9cad-9153ca7a568c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:53.398843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:53.443783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbc70d-40f6-4cbe-9cad-9153ca7a568c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:53.475921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:53.476475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:53.476752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:53.477021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:53.477670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:53.477965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:53.479318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:53.487491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 576/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:16:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:53.493357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:53.590778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b62914-2f81-4333-91c6-bcd6dcc7376f None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:53.623850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:53.624489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:53.624768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:53.625039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] PATH_INFO: `/v3/users/60ada0ca0a3a48048f89dc42519007a2` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:53.626140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=60ada0ca0a3a48048f89dc42519007a2)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:53.627559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:53.629126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 582/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:16:53 2022] GET /identity/v3/users/60ada0ca0a3a48048f89dc42519007a2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:53.634865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:53.733762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d55ea-dfb1-4ff2-998d-f0ba9b4b22af None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:53.746559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:53.766698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:53.767298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:53.767579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:53.767855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:53.831560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:53.833036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:53.927412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 577/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:53.933348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:53.964235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:54.029896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6e2b8-d263-4077-83c5-e69497ec9cf7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:54.062248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98547475-a385-46b0-9ca8-17c0297c5e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:54.062853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547475-a385-46b0-9ca8-17c0297c5e84 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:54.063131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547475-a385-46b0-9ca8-17c0297c5e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:54.063429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98547475-a385-46b0-9ca8-17c0297c5e84 None admin] PATH_INFO: `/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:54.064559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98547475-a385-46b0-9ca8-17c0297c5e84 None admin] RBAC: Authorizing `identity:get_project(project_id=2fe50481e8c34b9cbd0a15a9d5c245ab)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:54.065971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98547475-a385-46b0-9ca8-17c0297c5e84 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:54.067539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 583/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:16:53 2022] GET /identity/v3/projects/2fe50481e8c34b9cbd0a15a9d5c245ab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:54.073502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:54.087716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:54.167464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e222-dab5-46dd-adcb-0eb030f7bf12 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:54.199276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a30440-edca-4bfa-9d56-3fa5ca0376ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:54.199858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30440-edca-4bfa-9d56-3fa5ca0376ba None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:54.200135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30440-edca-4bfa-9d56-3fa5ca0376ba None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:54.200434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30440-edca-4bfa-9d56-3fa5ca0376ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:54.201146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a30440-edca-4bfa-9d56-3fa5ca0376ba None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=2fe50481e8c34b9cbd0a15a9d5c245ab, user.id=60ada0ca0a3a48048f89dc42519007a2) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:54.201451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a30440-edca-4bfa-9d56-3fa5ca0376ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:54.202890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a30440-edca-4bfa-9d56-3fa5ca0376ba None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:54.208390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 578/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:16:54 2022] GET /identity/v3/role_assignments?user.id=60ada0ca0a3a48048f89dc42519007a2&scope.project.id=2fe50481e8c34b9cbd0a15a9d5c245ab&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:56.340972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92dcb-911f-42ee-9e13-665f6422f13f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:56.341496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92dcb-911f-42ee-9e13-665f6422f13f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:56.341496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92dcb-911f-42ee-9e13-665f6422f13f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:56.342817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 584/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:56.348492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8996-7294-4e53-8bb3-bf7c02d2c1f8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:56.348873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8996-7294-4e53-8bb3-bf7c02d2c1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:56.349039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8996-7294-4e53-8bb3-bf7c02d2c1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:56.367880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-044d8996-7294-4e53-8bb3-bf7c02d2c1f8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:56.369072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-044d8996-7294-4e53-8bb3-bf7c02d2c1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:56.433473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 579/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:56.696236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92dcb-911f-42ee-9e13-665f6422f13f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:56.790067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:56.794023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92dcb-911f-42ee-9e13-665f6422f13f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:56.825090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:56.825680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:56.825958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:56.826226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:56.891059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:56.892524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:56.981715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:56.985422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 585/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:16:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:16:56.991166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d8996-7294-4e53-8bb3-bf7c02d2c1f8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:57.001760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:57.090303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d8996-7294-4e53-8bb3-bf7c02d2c1f8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:57.122015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeced7-abcc-49f1-8121-51efa716d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:57.122887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeced7-abcc-49f1-8121-51efa716d952 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:57.123164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeced7-abcc-49f1-8121-51efa716d952 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:57.123438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeced7-abcc-49f1-8121-51efa716d952 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:57.130362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeced7-abcc-49f1-8121-51efa716d952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:57.131797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeced7-abcc-49f1-8121-51efa716d952 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-eeeeced7-abcc-49f1-8121-51efa716d952 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:16:57.143307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:16:57.148550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:16:57.149693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 580/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:16:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:16:57.150693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:57.243262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17f4c9-0a8e-46bd-bb76-c902392192a7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:57.275952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb4cb5-9a0f-4afe-99bf-4f18ae52665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:57.276569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4cb5-9a0f-4afe-99bf-4f18ae52665a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:57.276849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4cb5-9a0f-4afe-99bf-4f18ae52665a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:57.277121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4cb5-9a0f-4afe-99bf-4f18ae52665a None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:57.277751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb4cb5-9a0f-4afe-99bf-4f18ae52665a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:16:57.278048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb4cb5-9a0f-4afe-99bf-4f18ae52665a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:57.279393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb4cb5-9a0f-4afe-99bf-4f18ae52665a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:57.286203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 586/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 21 05:16:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:16:59.391881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4df6f-e9d3-42db-8fbe-fedfb1c5aafd None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:59.395958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4df6f-e9d3-42db-8fbe-fedfb1c5aafd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:59.396247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4df6f-e9d3-42db-8fbe-fedfb1c5aafd None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:59.397834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 581/1167] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:16:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:16:59.403351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cca9c-a315-4612-a2ab-e817a3376854 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:59.403805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cca9c-a315-4612-a2ab-e817a3376854 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:59.403908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cca9c-a315-4612-a2ab-e817a3376854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:59.424110 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-cc2cca9c-a315-4612-a2ab-e817a3376854 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:16:59.425310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cc2cca9c-a315-4612-a2ab-e817a3376854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:16:59.480066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:59.489384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 587/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:16:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:16:59.756019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4df6f-e9d3-42db-8fbe-fedfb1c5aafd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:16:59.820517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:16:59.854854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4df6f-e9d3-42db-8fbe-fedfb1c5aafd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:16:59.887517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba712-ca4e-421f-8262-9364a202d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:16:59.888124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba712-ca4e-421f-8262-9364a202d0ab None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:16:59.888440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba712-ca4e-421f-8262-9364a202d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:16:59.888715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba712-ca4e-421f-8262-9364a202d0ab None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:16:59.889373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba712-ca4e-421f-8262-9364a202d0ab None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:16:59.891295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba712-ca4e-421f-8262-9364a202d0ab None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:16:59.906949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 582/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Sep 21 05:16:59 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:17:02.041954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3ab93-351f-417e-9bcd-85b620665f93 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:02.042499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3ab93-351f-417e-9bcd-85b620665f93 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:02.042499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3ab93-351f-417e-9bcd-85b620665f93 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:02.043814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 588/1170] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:17:02.049173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e343c6-3ccd-4424-8c29-51c7691593bb None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:02.049550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e343c6-3ccd-4424-8c29-51c7691593bb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:02.049714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e343c6-3ccd-4424-8c29-51c7691593bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:02.067287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-26e343c6-3ccd-4424-8c29-51c7691593bb None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:17:02.068479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-26e343c6-3ccd-4424-8c29-51c7691593bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:17:02.132106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 583/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:17:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:17:02.397026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3ab93-351f-417e-9bcd-85b620665f93 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:02.499839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3ab93-351f-417e-9bcd-85b620665f93 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:02.532694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499b800-534f-4ebc-9990-1f395eba0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:02.533313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b800-534f-4ebc-9990-1f395eba0a37 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:02.533592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b800-534f-4ebc-9990-1f395eba0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:02.533863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b800-534f-4ebc-9990-1f395eba0a37 None admin] PATH_INFO: `/v3/domains/32afd6b29f2149439c10c4ee95d55226` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:02.543700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499b800-534f-4ebc-9990-1f395eba0a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=32afd6b29f2149439c10c4ee95d55226)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:02.545163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499b800-534f-4ebc-9990-1f395eba0a37 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:02.547224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 589/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Sep 21 05:17:02 2022] GET /identity/v3/domains/32afd6b29f2149439c10c4ee95d55226 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:02.553207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e343c6-3ccd-4424-8c29-51c7691593bb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:02.607850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:02.648695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e343c6-3ccd-4424-8c29-51c7691593bb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:02.680518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2758be-b73f-4a92-b527-000dfa5cf22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:02.681112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2758be-b73f-4a92-b527-000dfa5cf22f None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:02.681389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2758be-b73f-4a92-b527-000dfa5cf22f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:02.681662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2758be-b73f-4a92-b527-000dfa5cf22f None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:02.682292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2758be-b73f-4a92-b527-000dfa5cf22f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:02.683709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2758be-b73f-4a92-b527-000dfa5cf22f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:02.708553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 584/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:17:02 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:17:04.869610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7ee3-6b0f-4f87-87d3-aba0ede46611 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:04.870015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7ee3-6b0f-4f87-87d3-aba0ede46611 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:04.870166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7ee3-6b0f-4f87-87d3-aba0ede46611 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:04.871501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 590/1174] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:17:04.877062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9784bfa-7765-40d0-bf17-18cfd661bf21 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:04.877445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9784bfa-7765-40d0-bf17-18cfd661bf21 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:04.877623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9784bfa-7765-40d0-bf17-18cfd661bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:04.895817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a9784bfa-7765-40d0-bf17-18cfd661bf21 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:17:04.897034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a9784bfa-7765-40d0-bf17-18cfd661bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:17:04.961727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 585/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:17:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:17:05.227879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7ee3-6b0f-4f87-87d3-aba0ede46611 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:05.286272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:05.330503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7ee3-6b0f-4f87-87d3-aba0ede46611 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:05.361813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d71da-ae95-4c00-b168-871f21dec964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:05.362431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d71da-ae95-4c00-b168-871f21dec964 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:05.362713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d71da-ae95-4c00-b168-871f21dec964 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:05.362988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d71da-ae95-4c00-b168-871f21dec964 None admin] PATH_INFO: `/v3/domains/32afd6b29f2149439c10c4ee95d55226` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:05.364102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d71da-ae95-4c00-b168-871f21dec964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=32afd6b29f2149439c10c4ee95d55226)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:05.365563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d71da-ae95-4c00-b168-871f21dec964 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:05.367095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 591/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Sep 21 05:17:05 2022] GET /identity/v3/domains/32afd6b29f2149439c10c4ee95d55226 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:05.373141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9784bfa-7765-40d0-bf17-18cfd661bf21 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:05.412796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:05.467556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9784bfa-7765-40d0-bf17-18cfd661bf21 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:05.499109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766ec58-7564-4128-bb93-e5da2abe4016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:05.500157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766ec58-7564-4128-bb93-e5da2abe4016 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:05.500459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766ec58-7564-4128-bb93-e5da2abe4016 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:05.500729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766ec58-7564-4128-bb93-e5da2abe4016 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:05.501366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766ec58-7564-4128-bb93-e5da2abe4016 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:05.502781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766ec58-7564-4128-bb93-e5da2abe4016 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:05.523684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 586/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:17:05 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:17:07.658098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cfd50-b33c-489d-8427-00e52f2222ec None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:07.658658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cfd50-b33c-489d-8427-00e52f2222ec None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:07.658658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cfd50-b33c-489d-8427-00e52f2222ec None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:07.659966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 592/1178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:17:07.665197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a5a29-e003-44ef-8107-45e1e80fd2ad None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:07.665643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a5a29-e003-44ef-8107-45e1e80fd2ad None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:07.665734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a5a29-e003-44ef-8107-45e1e80fd2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:07.685212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-248a5a29-e003-44ef-8107-45e1e80fd2ad None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:17:07.686381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-248a5a29-e003-44ef-8107-45e1e80fd2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:17:07.750326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 587/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:17:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:17:08.018681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cfd50-b33c-489d-8427-00e52f2222ec None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:08.116226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cfd50-b33c-489d-8427-00e52f2222ec None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:08.138129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:08.149633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:08.150246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:08.150525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:08.150797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:08.161606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:17:08.166344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:17:08.167416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:17:08.168384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 593/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:17:08.174014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a5a29-e003-44ef-8107-45e1e80fd2ad None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:08.199459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:08.270117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a5a29-e003-44ef-8107-45e1e80fd2ad None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:08.303090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:08.303682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:08.303966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:08.304242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:08.304929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:17:08.305233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:08.306605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:08.314485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 588/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:08.320316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:08.416375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3fde-2cc2-4e86-a337-26dbaea95b21 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:08.448083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:08.448722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:08.449003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:08.449273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] PATH_INFO: `/v3/users/71ce073c598040f9bdb0618fd92c5c0d` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:08.461625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] RBAC: Authorizing `identity:get_user(user_id=71ce073c598040f9bdb0618fd92c5c0d)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:08.463054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:08.464648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 594/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:17:08 2022] GET /identity/v3/users/71ce073c598040f9bdb0618fd92c5c0d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:08.470762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:08.556139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:08.568005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec3f14-db64-49cf-bc0e-bf51a9b86427 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:08.600857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:08.601452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:08.601737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:08.602007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:08.664873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:08.666303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:08.748426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:08.761022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 589/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:17:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:17:08.767600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:08.807364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:08.863991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e08b5-6644-47bf-abfa-124e5cd9f986 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:08.896663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f08ca-3643-422a-81c5-b2be2110002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:08.897294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f08ca-3643-422a-81c5-b2be2110002a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:08.897552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f08ca-3643-422a-81c5-b2be2110002a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:08.897820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f08ca-3643-422a-81c5-b2be2110002a None admin] PATH_INFO: `/v3/projects/a92f3c34296347399c6284070ffaab59` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:08.898913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f08ca-3643-422a-81c5-b2be2110002a None admin] RBAC: Authorizing `identity:get_project(project_id=a92f3c34296347399c6284070ffaab59)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:08.900356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f08ca-3643-422a-81c5-b2be2110002a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:08.901946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 595/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:17:08 2022] GET /identity/v3/projects/a92f3c34296347399c6284070ffaab59 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:08.908529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:09.002844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63378f-b993-455f-910b-81220355bae0 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:09.035020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62ccc3-8509-4ce4-b3c7-9ec60901a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:09.035609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62ccc3-8509-4ce4-b3c7-9ec60901a0fe None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:09.035889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62ccc3-8509-4ce4-b3c7-9ec60901a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:09.036162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62ccc3-8509-4ce4-b3c7-9ec60901a0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:09.036901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62ccc3-8509-4ce4-b3c7-9ec60901a0fe None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=a92f3c34296347399c6284070ffaab59, user.id=71ce073c598040f9bdb0618fd92c5c0d) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:17:09.037205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62ccc3-8509-4ce4-b3c7-9ec60901a0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:09.038621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62ccc3-8509-4ce4-b3c7-9ec60901a0fe None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:09.043728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 590/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:17:08 2022] GET /identity/v3/role_assignments?user.id=71ce073c598040f9bdb0618fd92c5c0d&scope.project.id=a92f3c34296347399c6284070ffaab59&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:11.141163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942e18-1112-4b83-aa07-c9f1a8a2928f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:11.141681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942e18-1112-4b83-aa07-c9f1a8a2928f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:11.141681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942e18-1112-4b83-aa07-c9f1a8a2928f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:11.142960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 596/1186] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:17:11.147976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4415-2e3e-46f4-805c-a7f9d924c6ab None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:11.148369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4415-2e3e-46f4-805c-a7f9d924c6ab None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:11.148566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4415-2e3e-46f4-805c-a7f9d924c6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:11.166524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6aad4415-2e3e-46f4-805c-a7f9d924c6ab None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:17:11.167683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6aad4415-2e3e-46f4-805c-a7f9d924c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:17:11.211733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:11.231011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 591/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:17:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:17:11.496269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942e18-1112-4b83-aa07-c9f1a8a2928f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:11.594150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942e18-1112-4b83-aa07-c9f1a8a2928f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:11.603786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:11.627720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:11.628361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:11.628643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:11.628915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:11.638555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:17:11.643757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:17:11.644868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:17:11.645733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 597/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:17:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:17:11.650736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad4415-2e3e-46f4-805c-a7f9d924c6ab None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:11.744833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad4415-2e3e-46f4-805c-a7f9d924c6ab None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:11.777343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:11.777874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:11.778148 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:11.778419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:11.779072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:17:11.779368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:11.781335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:11.788921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 592/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:11.794857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:11.891037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff69ce-ea72-447a-82d9-df5548c0bab7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:11.923000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:11.923611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:11.923886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:11.924153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] PATH_INFO: `/v3/users/71ce073c598040f9bdb0618fd92c5c0d` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:11.925283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] RBAC: Authorizing `identity:get_user(user_id=71ce073c598040f9bdb0618fd92c5c0d)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:11.926700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:11.928229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 598/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:17:11 2022] GET /identity/v3/users/71ce073c598040f9bdb0618fd92c5c0d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:11.934036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:11.978483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:12.031025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2852-5250-4df0-a035-1da10e10b8c2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:12.062633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123933ee-ed3f-44b4-8c57-927c15767c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:12.063256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123933ee-ed3f-44b4-8c57-927c15767c84 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:12.063537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123933ee-ed3f-44b4-8c57-927c15767c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:12.063814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123933ee-ed3f-44b4-8c57-927c15767c84 None admin] PATH_INFO: `/v3/projects/a92f3c34296347399c6284070ffaab59` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:12.064933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123933ee-ed3f-44b4-8c57-927c15767c84 None admin] RBAC: Authorizing `identity:get_project(project_id=a92f3c34296347399c6284070ffaab59)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:12.066351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123933ee-ed3f-44b4-8c57-927c15767c84 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:12.067937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 593/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:17:11 2022] GET /identity/v3/projects/a92f3c34296347399c6284070ffaab59 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:12.073738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:12.107879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:12.173740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29590f6f-795c-48f1-8f3f-8fc60a8d293c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:12.206004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771005-0092-415b-8a3d-d0537a1c0580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:12.206649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771005-0092-415b-8a3d-d0537a1c0580 None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:12.206927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771005-0092-415b-8a3d-d0537a1c0580 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:12.207197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771005-0092-415b-8a3d-d0537a1c0580 None admin] PATH_INFO: `/v3/projects/a92f3c34296347399c6284070ffaab59/users/71ce073c598040f9bdb0618fd92c5c0d/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:12.209075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771005-0092-415b-8a3d-d0537a1c0580 None admin] RBAC: Authorizing `identity:create_grant(project_id=a92f3c34296347399c6284070ffaab59, user_id=71ce073c598040f9bdb0618fd92c5c0d, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:12.210494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771005-0092-415b-8a3d-d0537a1c0580 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:12.222819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 599/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:17:12 2022] PUT /identity/v3/projects/a92f3c34296347399c6284070ffaab59/users/71ce073c598040f9bdb0618fd92c5c0d/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:17:14.316817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68103-5495-4b2b-81ac-b1f585904690 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:14.317314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68103-5495-4b2b-81ac-b1f585904690 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:14.317314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68103-5495-4b2b-81ac-b1f585904690 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:14.318594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 594/1193] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:17:14.323638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987f8b-fd12-4585-9667-471ab2a8301d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:14.324019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987f8b-fd12-4585-9667-471ab2a8301d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:14.324190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987f8b-fd12-4585-9667-471ab2a8301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:14.341879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-79987f8b-fd12-4585-9667-471ab2a8301d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:17:14.343570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-79987f8b-fd12-4585-9667-471ab2a8301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:17:14.406826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 600/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:17:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:17:14.677671 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68103-5495-4b2b-81ac-b1f585904690 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:14.774793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68103-5495-4b2b-81ac-b1f585904690 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:14.791940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:14.818454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:14.819075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:14.819351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:14.819618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:14.829889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:17:14.834596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:17:14.835696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:17:14.836791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 595/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:17:14.841734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79987f8b-fd12-4585-9667-471ab2a8301d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:14.867596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:14.938334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79987f8b-fd12-4585-9667-471ab2a8301d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:14.970491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:14.971085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:14.971360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:14.971627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:14.972320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:17:14.972620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:14.973968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:14.981626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 601/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:14.987482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:15.083931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c575e-7b6b-4671-a257-9f759af90d0e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:15.116516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:15.117151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:15.117424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:15.117694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] PATH_INFO: `/v3/users/71ce073c598040f9bdb0618fd92c5c0d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:15.118822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] RBAC: Authorizing `identity:get_user(user_id=71ce073c598040f9bdb0618fd92c5c0d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:15.120267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:15.122023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 596/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 21 05:17:14 2022] GET /identity/v3/users/71ce073c598040f9bdb0618fd92c5c0d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:15.128570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:15.212052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:15.223747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffaa81-22e8-4ae3-8afc-e1f4ddf6ed22 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:15.255953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:15.256575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:15.256854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:15.257129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:15.320868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:15.322303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:15.404703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:15.417710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 602/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:17:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:17:15.423737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:15.470753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:15.526873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4405-243d-4bf3-8538-6149d1f8acf1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:15.558583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8862da-b102-4dd6-aab5-4cc41e741dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:15.559218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8862da-b102-4dd6-aab5-4cc41e741dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:15.559492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8862da-b102-4dd6-aab5-4cc41e741dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:15.559762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8862da-b102-4dd6-aab5-4cc41e741dd8 None admin] PATH_INFO: `/v3/projects/a92f3c34296347399c6284070ffaab59` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:15.560865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8862da-b102-4dd6-aab5-4cc41e741dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=a92f3c34296347399c6284070ffaab59)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:15.562313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8862da-b102-4dd6-aab5-4cc41e741dd8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:15.563939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 597/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 21 05:17:15 2022] GET /identity/v3/projects/a92f3c34296347399c6284070ffaab59 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:15.570076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:17:15.664519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acabc03-6388-4452-96c4-66666e1e5e17 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:17:15.696872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929532f-614a-44bc-bd78-5128062da83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:17:15.697467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929532f-614a-44bc-bd78-5128062da83a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:17:15.697746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929532f-614a-44bc-bd78-5128062da83a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:17:15.698015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929532f-614a-44bc-bd78-5128062da83a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:17:15.698734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929532f-614a-44bc-bd78-5128062da83a None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=a92f3c34296347399c6284070ffaab59, user.id=71ce073c598040f9bdb0618fd92c5c0d) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:17:15.699039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929532f-614a-44bc-bd78-5128062da83a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:17:15.700488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929532f-614a-44bc-bd78-5128062da83a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:17:15.706094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 603/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:17:15 2022] GET /identity/v3/role_assignments?user.id=71ce073c598040f9bdb0618fd92c5c0d&scope.project.id=a92f3c34296347399c6284070ffaab59&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:17:25.554615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=46 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:17:25.703785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=74 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:11.495832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c65-fb7b-4562-9b65-0e69154d0a35 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:11.496452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c65-fb7b-4562-9b65-0e69154d0a35 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:11.496452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c65-fb7b-4562-9b65-0e69154d0a35 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:11.498526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 598/1201] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:11.505172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae7ad-75dd-47c2-9610-d741485bdcc1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:11.505172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae7ad-75dd-47c2-9610-d741485bdcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:11.505172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae7ad-75dd-47c2-9610-d741485bdcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:11.529378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-543ae7ad-75dd-47c2-9610-d741485bdcc1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:11.531288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-543ae7ad-75dd-47c2-9610-d741485bdcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:11.637851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 604/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:11.906267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975c65-fb7b-4562-9b65-0e69154d0a35 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:12.037470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975c65-fb7b-4562-9b65-0e69154d0a35 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:12.079312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:12.080000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:12.080395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:12.080823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:12.093172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:12.094892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:12.112103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:12.113627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:12.114819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:12.114819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:12.114819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:12.114819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 599/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:12.119514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ae7ad-75dd-47c2-9610-d741485bdcc1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:12.262058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ae7ad-75dd-47c2-9610-d741485bdcc1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:12.296194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:12.302741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3d26b-4532-4b71-8a60-966dccb6bc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:12.303632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d26b-4532-4b71-8a60-966dccb6bc12 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:12.304411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d26b-4532-4b71-8a60-966dccb6bc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:12.304727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d26b-4532-4b71-8a60-966dccb6bc12 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:12.305367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3d26b-4532-4b71-8a60-966dccb6bc12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:12.305676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3d26b-4532-4b71-8a60-966dccb6bc12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:12.307197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3d26b-4532-4b71-8a60-966dccb6bc12 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:12.320736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 605/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:18:12.326997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:12.392372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:12.446344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073954-dfb8-455d-aff0-28ae85dbaed8 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:12.487174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f53fe8-8776-4a2b-adbd-c6d0dcb70c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:12.487828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53fe8-8776-4a2b-adbd-c6d0dcb70c36 None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:12.488068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53fe8-8776-4a2b-adbd-c6d0dcb70c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:12.488366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f53fe8-8776-4a2b-adbd-c6d0dcb70c36 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:12.489008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f53fe8-8776-4a2b-adbd-c6d0dcb70c36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:12.490439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f53fe8-8776-4a2b-adbd-c6d0dcb70c36 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:12.524504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 600/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 21 05:18:12 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:18:14.906957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2d3a-0f1e-44fb-b7da-97392edb623c None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:14.907662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2d3a-0f1e-44fb-b7da-97392edb623c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:14.907662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2d3a-0f1e-44fb-b7da-97392edb623c None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:14.912339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 606/1206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:14.915300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd331c-4fdd-4f93-a162-cf564553a2d9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:14.915855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd331c-4fdd-4f93-a162-cf564553a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:14.915855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd331c-4fdd-4f93-a162-cf564553a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:14.937618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-09fd331c-4fdd-4f93-a162-cf564553a2d9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:14.938866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-09fd331c-4fdd-4f93-a162-cf564553a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:15.022680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 601/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:15.305155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2d3a-0f1e-44fb-b7da-97392edb623c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:15.427882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2d3a-0f1e-44fb-b7da-97392edb623c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:15.474039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:15.475002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:15.475462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:15.475881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:15.489284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:18:15.494339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:15.495298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:15.496190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 607/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:18:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:15.502920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd331c-4fdd-4f93-a162-cf564553a2d9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:15.553353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:15.633132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd331c-4fdd-4f93-a162-cf564553a2d9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:15.674992 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:15.675802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:15.676175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:15.676523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:15.677285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:15.677711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:15.679171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:15.694337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 602/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:18:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:15.695394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:15.756094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:15.818868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97de91-a8de-41e8-bf16-03ca8cff0ab9 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:15.864946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:15.866615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:15.867082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:15.867610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:15.884010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:15.885479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:15.902813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:15.904055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:15.905123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:15.905123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:15.905123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:15.908302 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 608/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:18:15.911674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:16.035942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:16.046691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d1ea-5993-4419-bd89-035ef9121978 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:16.091896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:16.092997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:16.093555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:16.094103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:16.095022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:16.095485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:16.097016 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:16.112629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 603/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:16.118076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:16.237897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891f67e-c702-420f-8acb-02f795f11d73 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:16.239375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:16.275545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:16.276184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:16.276489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:16.276767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:16.285053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:16.286548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:18:16.297649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:16.298783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:16.299755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:16.304735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:16.312420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 609/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:16.417486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae987c-79cf-488e-b1a8-bbd0c34df4cd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:16.459802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:16.460441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:16.460721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:16.460987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:16.461697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:16.461998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:16.463409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:16.483343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 604/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 05:18:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:16.489024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:16.600367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb0ae9-f63b-429d-8cb9-34a19d238363 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:16.638527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:16.639207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:16.639487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:16.639760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:16.676561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:16.719938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:16.721584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:16.843411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 610/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:18:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:18:16.846710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:16.870417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:16.973624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135677c-b3b1-4af9-9a9b-4cee208d2e89 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:17.012165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:17.012827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:17.013617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:17.013896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:17.026423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:17.027890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:17.046002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:17.052514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:17.053534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:17.053534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:17.053534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:17.053534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 605/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:17.053773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:17.124773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:17.175907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c79b3-8956-4642-9100-a0da9d956f20 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:17.221836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:17.222682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:17.223559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:17.223559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:17.223860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:17.224159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:17.225770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:17.239023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 611/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:17.245213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:17.324984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:17.359024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238398-1e4e-439b-b013-ecfc92df629a None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:17.396542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:17.397105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:17.397388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:17.397670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:17.404927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:17.406551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:18:17.418812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:17.420404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:17.426257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 606/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:17.426949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:17.537906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc01bc-97e0-4692-85f7-8dba105b335e None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:17.561593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:17.575512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b30ec-8027-4148-8343-7b10770727ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:17.576753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b30ec-8027-4148-8343-7b10770727ef None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:17.577006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b30ec-8027-4148-8343-7b10770727ef None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:17.577286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b30ec-8027-4148-8343-7b10770727ef None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:17.577977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b30ec-8027-4148-8343-7b10770727ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:17.578280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b30ec-8027-4148-8343-7b10770727ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:17.579709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b30ec-8027-4148-8343-7b10770727ef None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:17.599486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 612/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:18:17.601133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:17.708585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb589d3-c495-4a50-8312-433756ce1a8b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:17.739633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:17.745841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d9ebe-8d04-4e80-a82c-22bd945d6afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:17.746446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d9ebe-8d04-4e80-a82c-22bd945d6afb None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:17.746725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d9ebe-8d04-4e80-a82c-22bd945d6afb None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:17.746995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d9ebe-8d04-4e80-a82c-22bd945d6afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:17.748539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d9ebe-8d04-4e80-a82c-22bd945d6afb None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=5129b0c17f1a4579b26a2e50369648d6) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:17.748892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d9ebe-8d04-4e80-a82c-22bd945d6afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:17.750352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d9ebe-8d04-4e80-a82c-22bd945d6afb None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:17.756479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 607/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:18:17 2022] GET /identity/v3/role_assignments?user.id=5129b0c17f1a4579b26a2e50369648d6&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:20.176980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b194a-5b4b-4070-bfd3-15ec3b750a49 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:20.177500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b194a-5b4b-4070-bfd3-15ec3b750a49 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:20.177500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b194a-5b4b-4070-bfd3-15ec3b750a49 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:20.178879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 613/1220] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:20.184676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc464-df8f-471f-8a30-b61aa2f7b393 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:20.185751 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc464-df8f-471f-8a30-b61aa2f7b393 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:20.185962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc464-df8f-471f-8a30-b61aa2f7b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:20.206229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-851dc464-df8f-471f-8a30-b61aa2f7b393 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:20.207505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-851dc464-df8f-471f-8a30-b61aa2f7b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:20.285129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 608/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:20.600459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b194a-5b4b-4070-bfd3-15ec3b750a49 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:20.717133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b194a-5b4b-4070-bfd3-15ec3b750a49 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:20.755212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:20.755904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:20.756236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:20.756545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:20.767362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:18:20.772082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:20.773322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:20.774561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 614/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:18:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:20.779723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc464-df8f-471f-8a30-b61aa2f7b393 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:20.886171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc464-df8f-471f-8a30-b61aa2f7b393 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:20.910986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:20.925726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:20.926328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:20.926605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:20.926872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:20.927545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:20.927842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:20.929247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:20.937097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 609/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:18:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:20.942867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:20.989566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:21.045474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64194a8c-b32b-4694-9b8e-add314bc2752 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:21.080702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:21.081305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:21.081586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:21.081904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:21.094963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:21.096583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:21.111820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:21.113023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:21.114221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:21.114221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:21.114221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:21.117645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 615/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:21.118749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:21.221658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93f71-d958-4010-8814-7a1d17494d0b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:21.257132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:21.257801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:21.258082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:21.258360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:21.259056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:21.259383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:21.260864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:21.273617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 610/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:21.279593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:21.374049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:21.381206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa915a-8575-4d33-9561-8272608b0f2c None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:21.417440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:21.418066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:21.418343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:21.418619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:21.427018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:21.428707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:18:21.440999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:21.442220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:21.443396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 616/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:21.448164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:21.501198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:21.552561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7979-da21-4a6e-8883-f0fa8652307c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:21.597834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:21.598688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:21.599012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:21.599492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:21.600532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:21.601076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:21.603064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:21.625964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 611/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 05:18:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:21.632065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:21.742867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fed1c-c75e-45e2-9c87-a01bdd3f9463 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:21.779765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:21.780447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:21.780753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:21.781065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:21.792792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:21.794770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:21.809594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:21.811549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:21.812742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:21.812742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:21.812742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:21.812742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 617/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:18:21.819475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:21.936667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ed7f-c719-484b-b08e-cc01b1a9d854 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:21.938904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:21.977803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:21.978871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:21.979202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:21.979572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:21.980491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:21.980828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:21.982379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:21.994735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 612/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:22.001377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:22.010647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:22.108686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454318-7d95-4684-8a1e-eae13e7e55da None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:22.145415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:22.146103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:22.146415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:22.146715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:22.154377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:22.155863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:18:22.167410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:22.168527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:22.170176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:22.174334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 618/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:22.175196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:22.284080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aff17b-d71e-46e4-bc9a-b59c86036868 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:22.321596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71ba99-d95c-4435-9589-9cc9e5a0aca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:22.322330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ba99-d95c-4435-9589-9cc9e5a0aca0 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:22.322608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ba99-d95c-4435-9589-9cc9e5a0aca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:22.322878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ba99-d95c-4435-9589-9cc9e5a0aca0 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:22.323566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71ba99-d95c-4435-9589-9cc9e5a0aca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:22.323870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71ba99-d95c-4435-9589-9cc9e5a0aca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:22.325337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71ba99-d95c-4435-9589-9cc9e5a0aca0 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:22.337956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 613/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:22.345286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:22.413267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:22.448328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d14d-0d3a-42d4-a1b1-9c34e34f16f2 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:22.482967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136657a-2f3f-4e8d-a032-ad3f2c3587cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:22.483643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136657a-2f3f-4e8d-a032-ad3f2c3587cf None admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:22.483906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136657a-2f3f-4e8d-a032-ad3f2c3587cf None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:22.484182 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136657a-2f3f-4e8d-a032-ad3f2c3587cf None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/5129b0c17f1a4579b26a2e50369648d6/roles/ed997874e38746a3992f92bfdfabfeec` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:22.498753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136657a-2f3f-4e8d-a032-ad3f2c3587cf None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=5129b0c17f1a4579b26a2e50369648d6, role_id=ed997874e38746a3992f92bfdfabfeec)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:22.500205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136657a-2f3f-4e8d-a032-ad3f2c3587cf None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:22.512208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 619/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:18:22 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/5129b0c17f1a4579b26a2e50369648d6/roles/ed997874e38746a3992f92bfdfabfeec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:18:24.694158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7444b-da02-497d-9655-2fa87a4ca567 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:24.694908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7444b-da02-497d-9655-2fa87a4ca567 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:24.694908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7444b-da02-497d-9655-2fa87a4ca567 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:24.697624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 614/1233] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:24.703740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad5593-876f-4f5e-875b-0e035c73d54a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:24.704200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad5593-876f-4f5e-875b-0e035c73d54a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:24.704336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad5593-876f-4f5e-875b-0e035c73d54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:24.723214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-02ad5593-876f-4f5e-875b-0e035c73d54a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:24.725555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-02ad5593-876f-4f5e-875b-0e035c73d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:24.795770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 620/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 05:18:25.070359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7444b-da02-497d-9655-2fa87a4ca567 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:25.100000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:25.182299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7444b-da02-497d-9655-2fa87a4ca567 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:25.221690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:25.222340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:25.222618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:25.222890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:25.234102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:18:25.240231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:25.241538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:25.242613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 615/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 21 05:18:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:25.249190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad5593-876f-4f5e-875b-0e035c73d54a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:25.300194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:25.356509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad5593-876f-4f5e-875b-0e035c73d54a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:25.392801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:25.393417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:25.393700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:25.393976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:25.394653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:25.394957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:25.396444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:25.405949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 621/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 21 05:18:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:25.412387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:25.503683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:25.520966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fd0d5-2d0f-4ecf-8107-6c9268155061 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:25.555019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:25.555646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:25.555926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:25.556196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:25.566840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:25.568264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:25.586012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:25.587134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:25.588156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:25.588156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:25.588156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:25.593410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 616/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:25.594058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:25.708349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31addcc6-5451-4182-a88f-906ca76c28cd None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:25.718076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:25.749713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:25.750491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:25.750831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:25.751162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:25.752021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:25.752418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:25.754063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:25.766517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 622/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:25.772729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:25.889594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab8b2c-c57c-4c53-88a7-2909f18d3dd1 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:25.927900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:25.928560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:25.928841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:25.929115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:25.932061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:25.937376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:25.938852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:18:25.950548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:25.951592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:25.952617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 617/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:25.957700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:26.063684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb1b1-632f-4606-964d-d779c5116022 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:26.100784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:26.101443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:26.101727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:26.102009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:26.102807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:26.103141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:26.104658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:26.123846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 623/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 05:18:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:26.129945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:26.244548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341053d-b3b3-4309-be01-a73fe7144f5c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:26.279528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:26.280139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:26.280453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:26.280725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:26.344900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:26.351675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:26.353530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:26.463866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 618/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:18:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:18:26.469813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:26.499747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:26.582672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ef218-fd44-4433-a725-d889609274f3 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:26.618766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:26.619323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:26.619602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:26.619910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:26.630538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:26.632135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:26.648436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:26.649571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:26.650960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:26.650960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:26.650960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:26.650960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 624/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:26.656511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:26.773741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:26.780195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6bfef-4d7a-4a52-8869-49016c28b4af None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:26.815600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:26.816208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:26.816522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:26.816816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:26.817444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:26.817747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:26.819114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:26.831480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 619/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:26.837272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:26.923255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:26.950696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32d91d-1ed5-4c86-902d-deff11df131a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:26.987553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:26.988199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:26.988506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:26.988781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:26.995493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:26.996966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:18:27.010192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:27.011594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:27.012535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 625/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:27.017609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:27.124126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd61e2-a5df-4158-aa87-5a792b0fdd39 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:27.162623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29bba9-9f45-45f8-8134-ac5c8c360d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:27.163267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bba9-9f45-45f8-8134-ac5c8c360d8f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:27.163611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bba9-9f45-45f8-8134-ac5c8c360d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:27.163915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bba9-9f45-45f8-8134-ac5c8c360d8f None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:27.164758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29bba9-9f45-45f8-8134-ac5c8c360d8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:27.165067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29bba9-9f45-45f8-8134-ac5c8c360d8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:27.166680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29bba9-9f45-45f8-8134-ac5c8c360d8f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:27.180125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 620/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:27.186401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:27.298962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e8058-c252-4cc9-abcf-7197b56f9cfb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:27.334853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a13d4-d278-446a-a12e-a0828b4ddf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:27.335468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a13d4-d278-446a-a12e-a0828b4ddf37 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:27.335752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a13d4-d278-446a-a12e-a0828b4ddf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:27.336013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a13d4-d278-446a-a12e-a0828b4ddf37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:27.336770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a13d4-d278-446a-a12e-a0828b4ddf37 None admin] RBAC: Adding query filter params (role.id=ed997874e38746a3992f92bfdfabfeec, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=5129b0c17f1a4579b26a2e50369648d6) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:27.337078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a13d4-d278-446a-a12e-a0828b4ddf37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:27.338528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a13d4-d278-446a-a12e-a0828b4ddf37 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:27.344369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 626/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:18:27 2022] GET /identity/v3/role_assignments?user.id=5129b0c17f1a4579b26a2e50369648d6&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=ed997874e38746a3992f92bfdfabfeec => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:18:29.671906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228113c8-2fb2-4bc9-80cd-52b64641a9fe None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:29.672539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228113c8-2fb2-4bc9-80cd-52b64641a9fe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:29.672539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228113c8-2fb2-4bc9-80cd-52b64641a9fe None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:29.674034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 621/1247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:29.679337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dffd1-2e6d-4b3e-8588-5fa283b4ed39 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:29.679739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dffd1-2e6d-4b3e-8588-5fa283b4ed39 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:29.679895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dffd1-2e6d-4b3e-8588-5fa283b4ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:29.686713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:29.700729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-159dffd1-2e6d-4b3e-8588-5fa283b4ed39 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:29.701577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-159dffd1-2e6d-4b3e-8588-5fa283b4ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:29.772476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 627/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:30.060635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228113c8-2fb2-4bc9-80cd-52b64641a9fe None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:30.078936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:30.167117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228113c8-2fb2-4bc9-80cd-52b64641a9fe None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:30.201779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:30.202582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:30.202912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:30.203205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:30.214640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:18:30.220662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:30.221726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:30.222674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 622/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:30.228362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dffd1-2e6d-4b3e-8588-5fa283b4ed39 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:30.335544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dffd1-2e6d-4b3e-8588-5fa283b4ed39 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:30.366671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:30.373205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:30.373908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:30.374280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:30.374590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:30.375286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:30.375652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:30.377118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:30.386253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 628/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:18:30.393020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:30.475814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:30.501701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45578c5-7255-4b09-bfc2-25fe9d510cf3 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:30.538222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:30.538860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:30.539114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:30.539384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:30.552318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:30.553794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:30.569497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:30.570778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:30.571936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:30.571936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:30.571936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:30.571936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 623/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:18:30.576871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:30.692846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ef50b-94cd-408a-bad2-90f4faabc954 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:30.728256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:30.728913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:30.729209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:30.729536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:30.730200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:30.730508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:30.731907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:30.750398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 629/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:30.751561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:30.857448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c2bd-b90d-428d-a5b1-eacfe5ca2994 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:30.885296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:30.894926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:30.895564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:30.895843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:30.896114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:30.904678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:30.906135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:18:30.917945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:30.918969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:30.919998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 624/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:30.925113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:30.985219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:31.032526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944faf-bfc7-494b-985b-491449fedaa0 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:31.066105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:31.066714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:31.066989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:31.067263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:31.067989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:31.068307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:31.069738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:31.087885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 630/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 05:18:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:31.093993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:31.201114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60fa2b-89dc-4150-9ec5-14c024a05f05 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:31.234874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:31.235530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:31.235767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:31.236042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:31.291678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:31.304718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:31.306173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:31.400789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 625/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:18:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:18:31.407137 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:31.501658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259073-17fb-40c2-baa6-1fb85a72f395 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:31.514505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:31.535287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:31.535902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:31.536176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:31.536479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:31.547510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:31.549001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:31.563386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:31.564519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:31.565608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:31.565608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:31.565608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:31.565608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 631/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:31.570030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:31.661090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:31.674540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce6fb1-fd7b-4d18-a22e-0ffe99611e7f None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:31.707189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:31.707786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:31.708064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:31.708364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:31.709025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:31.709326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:31.710691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:31.721973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 626/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:31.727634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:31.822270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50160c1-54d3-405d-87ad-39d67c303081 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:31.853871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:31.854496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:31.854774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:31.855044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:31.861537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:31.862956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:18:31.874516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:31.875564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:31.876890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 632/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:31.881320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:31.981523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf471-30d7-4a47-bef7-548d3b9be79c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:32.016495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b791-e72d-4ea0-83df-9f89fe777746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:32.017098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b791-e72d-4ea0-83df-9f89fe777746 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:32.017378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b791-e72d-4ea0-83df-9f89fe777746 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:32.017647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b791-e72d-4ea0-83df-9f89fe777746 None admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:32.018325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b791-e72d-4ea0-83df-9f89fe777746 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:32.018627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b791-e72d-4ea0-83df-9f89fe777746 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:32.020047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b791-e72d-4ea0-83df-9f89fe777746 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:32.031889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 627/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:18:32.038502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:32.064008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:32.135910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c150b3-de61-44d4-b1da-c414324456f7 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:32.168090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06511c48-a9bb-4e6a-b94f-0b07733e2ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:32.169203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06511c48-a9bb-4e6a-b94f-0b07733e2ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:32.169486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06511c48-a9bb-4e6a-b94f-0b07733e2ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:32.169756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06511c48-a9bb-4e6a-b94f-0b07733e2ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:32.170468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06511c48-a9bb-4e6a-b94f-0b07733e2ee5 None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=5129b0c17f1a4579b26a2e50369648d6) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:32.170772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06511c48-a9bb-4e6a-b94f-0b07733e2ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:32.172190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06511c48-a9bb-4e6a-b94f-0b07733e2ee5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:32.177297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 633/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:18:32 2022] GET /identity/v3/role_assignments?user.id=5129b0c17f1a4579b26a2e50369648d6&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=7407c800e8af41e2bc429a186be077ba => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:34.266178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e78d-37d8-4a8b-ac0c-1007e2e93f5d None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:34.266695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e78d-37d8-4a8b-ac0c-1007e2e93f5d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:34.266695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e78d-37d8-4a8b-ac0c-1007e2e93f5d None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:34.267949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 628/1261] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:34.273046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b21291-ccf0-4b9c-afc3-d5fd6e06a9b4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:34.273443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b21291-ccf0-4b9c-afc3-d5fd6e06a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:34.273596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b21291-ccf0-4b9c-afc3-d5fd6e06a9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:34.291237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-38b21291-ccf0-4b9c-afc3-d5fd6e06a9b4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:34.292445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-38b21291-ccf0-4b9c-afc3-d5fd6e06a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:34.357477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 634/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:34.624566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6e78d-37d8-4a8b-ac0c-1007e2e93f5d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:34.636534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:34.727353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6e78d-37d8-4a8b-ac0c-1007e2e93f5d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:34.759426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:34.760048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:34.760355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:34.760633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:34.770829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:18:34.775592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:34.776713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:34.777752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 629/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:34.783386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b21291-ccf0-4b9c-afc3-d5fd6e06a9b4 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:34.800994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:34.880463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b21291-ccf0-4b9c-afc3-d5fd6e06a9b4 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:34.914213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:34.914812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:34.915095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:34.915370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:34.916031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:34.916362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:34.917724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:34.925554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 635/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:34.931269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:34.996591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:35.029506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33e6e8-e9d9-4b8c-9af6-393d25d97167 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:35.062697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:35.063313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:35.063592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:35.063866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:35.073475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:35.075436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:35.090150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:35.091260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:35.092360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:35.092360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:35.092360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:35.092360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 630/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 05:18:35.098486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:35.176753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:35.196422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8f71-6187-45a8-93b6-51801d22dccb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:35.229250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:35.229850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:35.230128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:35.230397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:35.231033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:35.231822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:35.233217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:35.244353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 636/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:35.250902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:35.345682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f119c-41ca-42d5-b0af-bc019cafeb2e None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:35.364902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:35.379888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:35.380529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:35.380806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:35.381072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:35.388251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:35.389714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:18:35.400340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:35.401400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:35.402470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 631/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:35.407138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:35.502607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6629d-9af0-4ac5-a28c-ec1578d13ae5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:35.534339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:35.534925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:35.535203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:35.535475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:35.536183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:35.536519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:35.537921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:35.546635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:35.554912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 637/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 05:18:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:35.560640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:35.667986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1da4-b741-4f9f-91eb-ee35c2045171 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:35.700655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:35.701265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:35.701539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:35.701805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:35.711864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:35.713318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:35.727232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:35.728171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:35.729296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:35.729296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:35.729296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:35.729296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 632/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:35.734646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:35.828514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813995-243a-4ea7-90df-7a3b1767528a None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:35.861715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:35.862315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:35.862592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:35.862861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:35.863496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:35.863795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:35.865180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:35.876148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 638/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:35.881835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:35.913037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:35.978693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4a0e-cfb0-4488-a60e-388cd43f34f2 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:36.010189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:36.010794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:36.011069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:36.011338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:36.018126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:36.019547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:18:36.030901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:36.031791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:36.032893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 633/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:36.037786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:36.097847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:36.138771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2bf46-e28a-4055-9c81-4e1d4c827b33 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:36.170399 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac642b-9757-4284-bb93-09e43a5677cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:36.170992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac642b-9757-4284-bb93-09e43a5677cd None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:36.171269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac642b-9757-4284-bb93-09e43a5677cd None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:36.171537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac642b-9757-4284-bb93-09e43a5677cd None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:36.172211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac642b-9757-4284-bb93-09e43a5677cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:36.172541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac642b-9757-4284-bb93-09e43a5677cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:36.173952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac642b-9757-4284-bb93-09e43a5677cd None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:36.185735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 639/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:36.191705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:36.279782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:36.288704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044b06a-d807-4b8b-a0bf-7bf135a7f42c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:36.320582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f953b90-3b5e-4309-88bc-3bb5a2507c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:36.321222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953b90-3b5e-4309-88bc-3bb5a2507c3e None admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:36.321503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953b90-3b5e-4309-88bc-3bb5a2507c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:36.321778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953b90-3b5e-4309-88bc-3bb5a2507c3e None admin] PATH_INFO: `/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/5129b0c17f1a4579b26a2e50369648d6/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:36.323625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f953b90-3b5e-4309-88bc-3bb5a2507c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=6d48605b85744148b56f5b8b79c213f3, user_id=5129b0c17f1a4579b26a2e50369648d6, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:36.325619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f953b90-3b5e-4309-88bc-3bb5a2507c3e None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:36.337631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 634/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 21 05:18:36 2022] PUT /identity/v3/projects/6d48605b85744148b56f5b8b79c213f3/users/5129b0c17f1a4579b26a2e50369648d6/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:18:38.470178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4233b-84d0-4357-9c41-852bdcf5cb91 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:38.470706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4233b-84d0-4357-9c41-852bdcf5cb91 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:38.470819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4233b-84d0-4357-9c41-852bdcf5cb91 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:38.472082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 640/1274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:38.477119 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546a507-2d14-49a7-94f2-a6a15e09d0c2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:38.477531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546a507-2d14-49a7-94f2-a6a15e09d0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:38.477677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546a507-2d14-49a7-94f2-a6a15e09d0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:38.495956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a546a507-2d14-49a7-94f2-a6a15e09d0c2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:38.497411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a546a507-2d14-49a7-94f2-a6a15e09d0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:38.560928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 635/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:38.834523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4233b-84d0-4357-9c41-852bdcf5cb91 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:38.938901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4233b-84d0-4357-9c41-852bdcf5cb91 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:38.956769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:38.973606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:38.974497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:38.974780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:38.975056 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:38.985085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 05:18:38.989812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:38.990896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:38.991937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 641/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 21 05:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:38.996927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546a507-2d14-49a7-94f2-a6a15e09d0c2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:39.075649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:39.095744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546a507-2d14-49a7-94f2-a6a15e09d0c2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:39.130591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:39.131194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:39.131470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:39.131739 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:39.132420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:39.132721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:39.134081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:39.141927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 636/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 21 05:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:39.147931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:39.243468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f72178-431a-45b5-9654-254fab91c169 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:39.275776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:39.276406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:39.276683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:39.276953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:39.286898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:39.288338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:39.302685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:39.303851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:39.304948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:39.304948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:39.304948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:39.304948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 642/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:39.309326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:39.407994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee434d-cdc4-4a3d-b6d6-95ff8d8a06ab None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:39.441556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:39.442164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:39.442441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:39.442712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:39.443343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:39.443641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:39.445034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:39.456396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 637/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:18:39.462053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:39.492359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:39.558614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66c09-384d-4de0-b039-c218fb2d565d None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:39.594830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:39.595444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:39.595719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:39.595986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:39.603193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:39.604632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 05:18:39.615844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:39.616953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:39.618294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 643/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:39.623013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:39.626725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:39.719433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c8f6b-ae07-420d-a066-3981854ef6cd None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:39.752503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:39.753096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:39.753371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:39.753641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:39.754347 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:39.754649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:39.756056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:39.772074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 638/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 21 05:18:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:39.777843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:39.863754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:39.874517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acd52b-d8ef-40e5-8b92-cb3fc61cbcbb None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:39.905752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:39.906340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:39.906617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:39.906885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:39.969879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:39.971237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:40.055372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:40.067911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 644/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 21 05:18:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 05:18:40.073889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:40.133682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:40.171214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5eb8-2db4-41b8-93e1-06662de9941c None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:40.204494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:40.205115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:40.205398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:40.205672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:40.215830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:40.217295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 05:18:40.232786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:40.233896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 05:18:40.234997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 05:18:40.234997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 05:18:40.234997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:40.234997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 639/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:40.239622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:40.336888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee8825-bed3-4758-9831-d06c78fd3e36 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:40.368902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:40.369506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:40.369787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:40.370062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:40.370700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:40.371004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:40.373163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:40.383878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 645/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 21 05:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:40.390062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:40.486600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847512f-ea1f-46a1-bae2-13a219436592 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:40.500197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:40.519560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:40.520172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:40.520506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:40.520779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:40.527113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:40.528601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 05:18:40.539426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:40.540501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: ERROR keystone.server.flask.application Sep 21 05:18:40.541773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 640/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 21 05:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:40.546833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:40.600976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:40.649129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6cae-0897-44af-902d-797987ebdc41 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:40.681235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88cd00-f5d7-4255-bb4c-a7cc86a8c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:40.681830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88cd00-f5d7-4255-bb4c-a7cc86a8c55b None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:40.682112 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88cd00-f5d7-4255-bb4c-a7cc86a8c55b None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:40.682388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88cd00-f5d7-4255-bb4c-a7cc86a8c55b None admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:40.683078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88cd00-f5d7-4255-bb4c-a7cc86a8c55b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:40.683387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88cd00-f5d7-4255-bb4c-a7cc86a8c55b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:40.684868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88cd00-f5d7-4255-bb4c-a7cc86a8c55b None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:40.696246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 646/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 21 05:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:40.702754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:40.799165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2e70f-5673-4cc0-a943-887dd2f1a0a6 None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:40.831830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a552aa0-6c54-494c-aac6-21e089f22a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:40.832444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552aa0-6c54-494c-aac6-21e089f22a3a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:40.832727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552aa0-6c54-494c-aac6-21e089f22a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:40.833000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552aa0-6c54-494c-aac6-21e089f22a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:40.833720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a552aa0-6c54-494c-aac6-21e089f22a3a None admin] RBAC: Adding query filter params (role.id=7407c800e8af41e2bc429a186be077ba, scope.project.id=6d48605b85744148b56f5b8b79c213f3, user.id=5129b0c17f1a4579b26a2e50369648d6) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:40.834031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a552aa0-6c54-494c-aac6-21e089f22a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:40.835454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a552aa0-6c54-494c-aac6-21e089f22a3a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:40.841086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 641/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 21 05:18:40 2022] GET /identity/v3/role_assignments?user.id=5129b0c17f1a4579b26a2e50369648d6&scope.project.id=6d48605b85744148b56f5b8b79c213f3&role.id=7407c800e8af41e2bc429a186be077ba => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:42.974267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79aaee-c50a-4a95-893e-67d6c516755c None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:42.974782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79aaee-c50a-4a95-893e-67d6c516755c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:42.974782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79aaee-c50a-4a95-893e-67d6c516755c None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:42.976126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 647/1288] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:42.981404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496a13-8a74-4797-8274-9c6bf8804329 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:42.981821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496a13-8a74-4797-8274-9c6bf8804329 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:42.981963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496a13-8a74-4797-8274-9c6bf8804329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:42.999964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-59496a13-8a74-4797-8274-9c6bf8804329 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:43.001177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-59496a13-8a74-4797-8274-9c6bf8804329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:43.030362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:43.066036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 642/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:43.336673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79aaee-c50a-4a95-893e-67d6c516755c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:43.439495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79aaee-c50a-4a95-893e-67d6c516755c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:43.449787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:43.472382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:43.472998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:43.473273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:43.473543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:43.474117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:43.475472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:43.484405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:43.485603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:43.486675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 648/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:18:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:43.491560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496a13-8a74-4797-8274-9c6bf8804329 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:43.589990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496a13-8a74-4797-8274-9c6bf8804329 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:43.629634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2701cc-2c26-43c7-8728-042d4484e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:43.630302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2701cc-2c26-43c7-8728-042d4484e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:43.630651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2701cc-2c26-43c7-8728-042d4484e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:43.630987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2701cc-2c26-43c7-8728-042d4484e8f4 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:43.631819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2701cc-2c26-43c7-8728-042d4484e8f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:43.632173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2701cc-2c26-43c7-8728-042d4484e8f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:43.633913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2701cc-2c26-43c7-8728-042d4484e8f4 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:43.647800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 643/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 05:18:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:43.649028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:43.745950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011687-0e0a-4112-be27-d24804c89757 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:43.778614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1314b-ad2c-4203-a93c-17f2bb7abfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:43.779208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1314b-ad2c-4203-a93c-17f2bb7abfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:43.779487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1314b-ad2c-4203-a93c-17f2bb7abfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:43.779754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1314b-ad2c-4203-a93c-17f2bb7abfa5 None admin] PATH_INFO: `/v3/services` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:43.780404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1314b-ad2c-4203-a93c-17f2bb7abfa5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:43.780707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1314b-ad2c-4203-a93c-17f2bb7abfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:43.782066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1314b-ad2c-4203-a93c-17f2bb7abfa5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:43.786270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 649/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 05:18:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:45.905942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb22a16-0db0-4d36-a1b0-d149411213ae None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:45.906445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb22a16-0db0-4d36-a1b0-d149411213ae None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:45.906539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb22a16-0db0-4d36-a1b0-d149411213ae None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:45.907805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 644/1293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:45.912891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe6ef5-90b9-4547-bc70-00c0b76de6d1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:45.913298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe6ef5-90b9-4547-bc70-00c0b76de6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:45.913451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe6ef5-90b9-4547-bc70-00c0b76de6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:45.931752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8abe6ef5-90b9-4547-bc70-00c0b76de6d1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:45.932968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8abe6ef5-90b9-4547-bc70-00c0b76de6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:45.961744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:45.999122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 650/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:46.264678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb22a16-0db0-4d36-a1b0-d149411213ae None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:46.295229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:46.362901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb22a16-0db0-4d36-a1b0-d149411213ae None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:46.395324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103b9dc-d1dd-40fd-ade3-5f28034d12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:46.395915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b9dc-d1dd-40fd-ade3-5f28034d12fd None admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:46.396195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b9dc-d1dd-40fd-ade3-5f28034d12fd None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:46.396496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b9dc-d1dd-40fd-ade3-5f28034d12fd None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:46.397147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103b9dc-d1dd-40fd-ade3-5f28034d12fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:46.398502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103b9dc-d1dd-40fd-ade3-5f28034d12fd None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:46.412354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 645/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 21 05:18:46 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:18:48.562858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db7d7-edd6-4241-a2c1-2c067ecf2d7f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:48.563381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db7d7-edd6-4241-a2c1-2c067ecf2d7f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:48.563381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db7d7-edd6-4241-a2c1-2c067ecf2d7f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:48.564753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 651/1296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:48.569892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b564-a0dc-407a-9b7e-c08f825426fa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:48.570300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b564-a0dc-407a-9b7e-c08f825426fa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:48.570466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b564-a0dc-407a-9b7e-c08f825426fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:48.591315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5b75b564-a0dc-407a-9b7e-c08f825426fa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:48.592538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5b75b564-a0dc-407a-9b7e-c08f825426fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:48.666811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 646/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:48.931115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4db7d7-edd6-4241-a2c1-2c067ecf2d7f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:49.028116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4db7d7-edd6-4241-a2c1-2c067ecf2d7f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:49.059988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:49.060676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:49.060954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:49.061222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:49.061792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:49.063147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:49.071490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:49.072692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:49.073733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 652/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:18:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:49.078508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75b564-a0dc-407a-9b7e-c08f825426fa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:49.096268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:49.173978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75b564-a0dc-407a-9b7e-c08f825426fa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:49.205330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:49.205915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:49.206191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:49.206459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:49.207070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:49.207365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:49.208750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:49.213583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 647/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 05:18:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:49.219947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:49.251438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:49.319730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7b3d7-32a4-48d2-bb8d-ff4c964e79f5 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:49.351904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12892056-d52a-410a-bc54-554c5ddae134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:49.352525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892056-d52a-410a-bc54-554c5ddae134 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:49.352805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892056-d52a-410a-bc54-554c5ddae134 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:49.353076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892056-d52a-410a-bc54-554c5ddae134 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:49.353770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12892056-d52a-410a-bc54-554c5ddae134 None admin] RBAC: Adding query filter params (interface=public, service_id=6bba6fe80ac04d10af6eb0737c5ff0ef, region_id=RegionOne) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:49.354077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12892056-d52a-410a-bc54-554c5ddae134 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:49.355434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12892056-d52a-410a-bc54-554c5ddae134 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:49.360848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 653/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 21 05:18:49 2022] GET /identity/v3/endpoints?service_id=6bba6fe80ac04d10af6eb0737c5ff0ef&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:49.366424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:49.450043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:49.468533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2e9fa-af0a-4d2a-af61-cae2173fda6b None admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:49.501128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97554e2a-5047-423c-97ba-83f17e08ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:49.501727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554e2a-5047-423c-97ba-83f17e08ac22 None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:49.502006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554e2a-5047-423c-97ba-83f17e08ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:49.502278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554e2a-5047-423c-97ba-83f17e08ac22 None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:49.502871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97554e2a-5047-423c-97ba-83f17e08ac22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:49.504229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97554e2a-5047-423c-97ba-83f17e08ac22 None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:49.510822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 648/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 21 05:18:49 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:18:51.606627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4b67-3b05-4621-b19a-29cb806dfed9 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:51.607162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4b67-3b05-4621-b19a-29cb806dfed9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:51.607162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4b67-3b05-4621-b19a-29cb806dfed9 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:51.608548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 654/1302] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:18:51.613595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be95eed-0cf2-4fef-8db8-c0f8355c712f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:51.614008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be95eed-0cf2-4fef-8db8-c0f8355c712f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:51.614147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be95eed-0cf2-4fef-8db8-c0f8355c712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:51.632490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1be95eed-0cf2-4fef-8db8-c0f8355c712f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:18:51.633666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1be95eed-0cf2-4fef-8db8-c0f8355c712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:18:51.697826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 649/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:18:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 05:18:51.964886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4b67-3b05-4621-b19a-29cb806dfed9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:52.056365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:52.064015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4b67-3b05-4621-b19a-29cb806dfed9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:52.096497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:52.097108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:52.097386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:52.097654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:52.098226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:52.099584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 05:18:52.109389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 05:18:52.110535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application with Lock( Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self._enter() Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application return self.creator() Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application created_value = creator( Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: ERROR keystone.server.flask.application Sep 21 05:18:52.111678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 655/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 21 05:18:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 05:18:52.117547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be95eed-0cf2-4fef-8db8-c0f8355c712f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:52.190338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:18:52.212046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be95eed-0cf2-4fef-8db8-c0f8355c712f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:52.244750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac774f-2870-4013-8746-f4447db34f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:52.245342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac774f-2870-4013-8746-f4447db34f3a None admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:52.245618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac774f-2870-4013-8746-f4447db34f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:52.245888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac774f-2870-4013-8746-f4447db34f3a None admin] PATH_INFO: `/v3/services` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:52.246547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac774f-2870-4013-8746-f4447db34f3a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:18:52.246846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac774f-2870-4013-8746-f4447db34f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:52.248474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac774f-2870-4013-8746-f4447db34f3a None admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:52.253328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 650/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 21 05:18:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:18:52.259037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:18:52.356587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e7782-9f99-4232-a5d4-5e88005dd270 None admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:18:52.389347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440bcd-4409-46e1-84a8-2ddcb4092992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:18:52.389882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440bcd-4409-46e1-84a8-2ddcb4092992 None admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:18:52.390162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440bcd-4409-46e1-84a8-2ddcb4092992 None admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:18:52.390433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440bcd-4409-46e1-84a8-2ddcb4092992 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:18:52.391099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440bcd-4409-46e1-84a8-2ddcb4092992 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:18:52.392488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440bcd-4409-46e1-84a8-2ddcb4092992 None admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:18:52.411284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 656/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:18:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:19:02.250552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=30 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:19:02.407064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:19:56.347930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd53f-b1e0-40d5-96a7-b2d4c007c878 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:19:56.348444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd53f-b1e0-40d5-96a7-b2d4c007c878 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:19:56.348528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd53f-b1e0-40d5-96a7-b2d4c007c878 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:19:56.355272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c672762-9357-472a-af1a-a515123d88a7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:19:56.355655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c672762-9357-472a-af1a-a515123d88a7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:19:56.355816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c672762-9357-472a-af1a-a515123d88a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:19:56.360708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 651/1307] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:19:56 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:19:56.440149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1c672762-9357-472a-af1a-a515123d88a7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:19:56.441395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1c672762-9357-472a-af1a-a515123d88a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:19:56.559680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 657/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:19:56.861330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5331e0-61bf-4350-9ce4-f811c752e7aa None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:19:56.861702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5331e0-61bf-4350-9ce4-f811c752e7aa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:19:56.862070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5331e0-61bf-4350-9ce4-f811c752e7aa None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:19:56.863855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 652/1309] 10.222.0.27 () {54 vars in 963 bytes} [Wed Sep 21 05:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:19:56.870244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e5f7-8410-48e3-bf2c-f0fa16ddadba None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:19:56.870606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e5f7-8410-48e3-bf2c-f0fa16ddadba None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:19:56.870958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e5f7-8410-48e3-bf2c-f0fa16ddadba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:19:56.960677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-cf75e5f7-8410-48e3-bf2c-f0fa16ddadba None None] MFA Rules not processed for user `f354351c3e9d41d09ea2610b47cefa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:19:56.961924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cf75e5f7-8410-48e3-bf2c-f0fa16ddadba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:19:56.986813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:19:57.048864 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 658/1310] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Sep 21 05:19:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:19:57.063096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5331e0-61bf-4350-9ce4-f811c752e7aa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:19:57.065155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2e5331e0-61bf-4350-9ce4-f811c752e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:19:57.179317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5331e0-61bf-4350-9ce4-f811c752e7aa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:19:57.258496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc339e6-e3ce-4e4c-b671-88a590d874b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:19:57.259545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc339e6-e3ce-4e4c-b671-88a590d874b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:19:57.259945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc339e6-e3ce-4e4c-b671-88a590d874b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:19:57.260225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc339e6-e3ce-4e4c-b671-88a590d874b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:19:57.261976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fdc339e6-e3ce-4e4c-b671-88a590d874b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:19:57.324564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:19:57.392097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc339e6-e3ce-4e4c-b671-88a590d874b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:19:57.393879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc339e6-e3ce-4e4c-b671-88a590d874b2 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:19:57.415254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 653/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:19:59.877421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4d32-c510-435e-a4f3-c1eb4e2702f2 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:19:59.877916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4d32-c510-435e-a4f3-c1eb4e2702f2 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:19:59.877916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4d32-c510-435e-a4f3-c1eb4e2702f2 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:19:59.879223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 659/1312] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:19:59.885059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6444d6-ec34-4d3d-92d7-3d4aff21e3f4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:19:59.885549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6444d6-ec34-4d3d-92d7-3d4aff21e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:19:59.885648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6444d6-ec34-4d3d-92d7-3d4aff21e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:19:59.954884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4a6444d6-ec34-4d3d-92d7-3d4aff21e3f4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:19:59.956087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4a6444d6-ec34-4d3d-92d7-3d4aff21e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:00.050919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 654/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:00.335721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4d32-c510-435e-a4f3-c1eb4e2702f2 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:00.337293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-fbdd4d32-c510-435e-a4f3-c1eb4e2702f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:00.442811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4d32-c510-435e-a4f3-c1eb4e2702f2 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:00.517829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:00.520316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cecfd-7c77-4279-9a1a-e4cc1b5a4ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:00.521298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cecfd-7c77-4279-9a1a-e4cc1b5a4ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:00.521588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cecfd-7c77-4279-9a1a-e4cc1b5a4ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:00.522031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cecfd-7c77-4279-9a1a-e4cc1b5a4ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:00.523871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5e6cecfd-7c77-4279-9a1a-e4cc1b5a4ab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:00.630272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cecfd-7c77-4279-9a1a-e4cc1b5a4ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:00.631722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cecfd-7c77-4279-9a1a-e4cc1b5a4ab5 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:00.649858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 660/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:03.072817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759c5d-9ebe-4cb3-891f-db4417223d32 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:03.073348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759c5d-9ebe-4cb3-891f-db4417223d32 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:03.073348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759c5d-9ebe-4cb3-891f-db4417223d32 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:03.074684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 655/1315] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:03.080088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfd93-6d74-48c3-9638-f46b75c23015 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:03.080574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfd93-6d74-48c3-9638-f46b75c23015 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:03.080685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfd93-6d74-48c3-9638-f46b75c23015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:03.145569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d89bfd93-6d74-48c3-9638-f46b75c23015 None None] MFA Rules not processed for user `1c081f9eab664b059dac8390c8aac361`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:03.146694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d89bfd93-6d74-48c3-9638-f46b75c23015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:03.197060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:03.241153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 661/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:03.521935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759c5d-9ebe-4cb3-891f-db4417223d32 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:03.523483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f2759c5d-9ebe-4cb3-891f-db4417223d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:03.533546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:03.625999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759c5d-9ebe-4cb3-891f-db4417223d32 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:03.697969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350599d-a807-4087-9d70-07ea1a1ddd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:03.698566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350599d-a807-4087-9d70-07ea1a1ddd67 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:03.698839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350599d-a807-4087-9d70-07ea1a1ddd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:03.699105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350599d-a807-4087-9d70-07ea1a1ddd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:03.700700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6350599d-a807-4087-9d70-07ea1a1ddd67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:03.760685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:03.805772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350599d-a807-4087-9d70-07ea1a1ddd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:03.807124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350599d-a807-4087-9d70-07ea1a1ddd67 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:03.825163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 656/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:06.478489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941b588-5909-402a-9180-3d52ef1ef21f None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:06.479026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941b588-5909-402a-9180-3d52ef1ef21f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:06.479026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941b588-5909-402a-9180-3d52ef1ef21f None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:06.480521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 662/1318] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:06.485670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24545f-a82e-4c1d-8aa3-cfdbfe64f04a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:06.486091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24545f-a82e-4c1d-8aa3-cfdbfe64f04a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:06.486217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24545f-a82e-4c1d-8aa3-cfdbfe64f04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:06.553132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-be24545f-a82e-4c1d-8aa3-cfdbfe64f04a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:06.554312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-be24545f-a82e-4c1d-8aa3-cfdbfe64f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:06.653882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 657/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:20:06.937593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941b588-5909-402a-9180-3d52ef1ef21f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:06.939162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2941b588-5909-402a-9180-3d52ef1ef21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:07.042990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941b588-5909-402a-9180-3d52ef1ef21f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:07.113907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d968b62-cffb-436f-9b61-72b035360235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:07.114437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d968b62-cffb-436f-9b61-72b035360235 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:07.114714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d968b62-cffb-436f-9b61-72b035360235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:07.114982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d968b62-cffb-436f-9b61-72b035360235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:07.116568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8d968b62-cffb-436f-9b61-72b035360235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:07.123887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:07.221588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d968b62-cffb-436f-9b61-72b035360235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:07.223012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d968b62-cffb-436f-9b61-72b035360235 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:07.241078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 663/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:09.992138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15497-1cb1-44f7-951e-c0e1d2cf5c9c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:09.992674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15497-1cb1-44f7-951e-c0e1d2cf5c9c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:09.992674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15497-1cb1-44f7-951e-c0e1d2cf5c9c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:09.993986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 658/1321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:09.999433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f778db-fda2-45a5-b61d-2bc45983977e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:09.999823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f778db-fda2-45a5-b61d-2bc45983977e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:09.999978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f778db-fda2-45a5-b61d-2bc45983977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:10.068603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-70f778db-fda2-45a5-b61d-2bc45983977e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:10.069843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-70f778db-fda2-45a5-b61d-2bc45983977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:10.132922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:10.175045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 664/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:10.454868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15497-1cb1-44f7-951e-c0e1d2cf5c9c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:10.456398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-74b15497-1cb1-44f7-951e-c0e1d2cf5c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:10.476653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:10.563586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15497-1cb1-44f7-951e-c0e1d2cf5c9c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:10.637197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1e015-73e1-404e-ac6d-d7a5a1dbb85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:10.637804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e015-73e1-404e-ac6d-d7a5a1dbb85f service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:10.638082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e015-73e1-404e-ac6d-d7a5a1dbb85f service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:10.638351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e015-73e1-404e-ac6d-d7a5a1dbb85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:10.639929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f9b1e015-73e1-404e-ac6d-d7a5a1dbb85f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:10.708877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:10.747271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1e015-73e1-404e-ac6d-d7a5a1dbb85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:10.748735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1e015-73e1-404e-ac6d-d7a5a1dbb85f service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:10.766634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 659/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:12.978075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8d00-ecb3-4800-926b-95adcbe6067b None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:12.978639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8d00-ecb3-4800-926b-95adcbe6067b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:12.978639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8d00-ecb3-4800-926b-95adcbe6067b None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:12.980009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 665/1324] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:12.985355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd2f6a-d08b-4281-a287-8197720f94d0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:12.985744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd2f6a-d08b-4281-a287-8197720f94d0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:12.985934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd2f6a-d08b-4281-a287-8197720f94d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:13.052237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-56dd2f6a-d08b-4281-a287-8197720f94d0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:13.053462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-56dd2f6a-d08b-4281-a287-8197720f94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:13.155413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 660/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:13.447338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6168a0-f2b7-4230-b0da-560bfb9dff4a None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:13.447619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6168a0-f2b7-4230-b0da-560bfb9dff4a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:13.447891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6168a0-f2b7-4230-b0da-560bfb9dff4a None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:13.449269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 666/1326] 10.222.0.27 () {54 vars in 963 bytes} [Wed Sep 21 05:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:13.455103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e6ad-412d-4753-89a6-19910c2174ca None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:13.455390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e6ad-412d-4753-89a6-19910c2174ca None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:13.455663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e6ad-412d-4753-89a6-19910c2174ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:13.486496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:13.532534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3c76e6ad-412d-4753-89a6-19910c2174ca None None] MFA Rules not processed for user `f354351c3e9d41d09ea2610b47cefa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:13.533720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3c76e6ad-412d-4753-89a6-19910c2174ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:13.609427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 661/1327] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Sep 21 05:20:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:13.618546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6168a0-f2b7-4230-b0da-560bfb9dff4a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:13.620054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ef6168a0-f2b7-4230-b0da-560bfb9dff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:13.722335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6168a0-f2b7-4230-b0da-560bfb9dff4a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:13.794850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04acc5-b2cd-4648-b883-9b0f24f19942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:13.795454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04acc5-b2cd-4648-b883-9b0f24f19942 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:13.795734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04acc5-b2cd-4648-b883-9b0f24f19942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:13.796000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04acc5-b2cd-4648-b883-9b0f24f19942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:13.797600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-da04acc5-b2cd-4648-b883-9b0f24f19942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:13.815719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:13.909938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04acc5-b2cd-4648-b883-9b0f24f19942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:13.911365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04acc5-b2cd-4648-b883-9b0f24f19942 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:13.928916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 667/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:16.370871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88641-e979-49f7-acfb-c973573eecd1 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:16.371349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88641-e979-49f7-acfb-c973573eecd1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:16.371431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88641-e979-49f7-acfb-c973573eecd1 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:16.373246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 662/1329] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:16.378615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da369-25be-43fa-ab1a-c675816ab54b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:16.379078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da369-25be-43fa-ab1a-c675816ab54b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:16.379189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da369-25be-43fa-ab1a-c675816ab54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:16.450248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-462da369-25be-43fa-ab1a-c675816ab54b None None] MFA Rules not processed for user `1c081f9eab664b059dac8390c8aac361`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:16.451478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-462da369-25be-43fa-ab1a-c675816ab54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:16.519128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:16.556219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 668/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:16.837964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88641-e979-49f7-acfb-c973573eecd1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:16.839504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ddc88641-e979-49f7-acfb-c973573eecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:16.945222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88641-e979-49f7-acfb-c973573eecd1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:16.965168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:17.019214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1826798-6b19-479c-b4b2-a30db38a662a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:17.019835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826798-6b19-479c-b4b2-a30db38a662a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:17.020122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826798-6b19-479c-b4b2-a30db38a662a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:17.020428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826798-6b19-479c-b4b2-a30db38a662a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:17.022045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a1826798-6b19-479c-b4b2-a30db38a662a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:17.133453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826798-6b19-479c-b4b2-a30db38a662a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:17.134907 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826798-6b19-479c-b4b2-a30db38a662a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:17.153474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 663/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:19.697830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307856-e362-4a68-a2f5-7991b175c7cf None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:19.698581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307856-e362-4a68-a2f5-7991b175c7cf None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:19.698581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307856-e362-4a68-a2f5-7991b175c7cf None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:19.699708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 669/1332] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:19.705104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19dede-40f6-4193-b5d8-368ead0389b3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:19.705545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19dede-40f6-4193-b5d8-368ead0389b3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:19.705662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19dede-40f6-4193-b5d8-368ead0389b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:19.771537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:19.774847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ac19dede-40f6-4193-b5d8-368ead0389b3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:19.776604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ac19dede-40f6-4193-b5d8-368ead0389b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:19.871794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 664/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:20.167724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307856-e362-4a68-a2f5-7991b175c7cf None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:20.169296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-15307856-e362-4a68-a2f5-7991b175c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:20.270194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307856-e362-4a68-a2f5-7991b175c7cf None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:20.346887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab9b72-18f2-4bb5-bcbb-989c6cc988fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:20.347535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9b72-18f2-4bb5-bcbb-989c6cc988fb service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:20.347820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9b72-18f2-4bb5-bcbb-989c6cc988fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:20.348100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9b72-18f2-4bb5-bcbb-989c6cc988fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:20.349894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7aab9b72-18f2-4bb5-bcbb-989c6cc988fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:20.381860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:20.464913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab9b72-18f2-4bb5-bcbb-989c6cc988fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:20.466256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab9b72-18f2-4bb5-bcbb-989c6cc988fb service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:20.483907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 670/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:22.659240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52422-768b-484c-bfa6-f798ffffaeeb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:22.659771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52422-768b-484c-bfa6-f798ffffaeeb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:22.659771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52422-768b-484c-bfa6-f798ffffaeeb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:22.661149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 665/1335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:22.666357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271b5e-f8ff-4738-b4b4-992404510398 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:22.666787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271b5e-f8ff-4738-b4b4-992404510398 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:22.666933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271b5e-f8ff-4738-b4b4-992404510398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:22.730814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-b8271b5e-f8ff-4738-b4b4-992404510398 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:22.732012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b8271b5e-f8ff-4738-b4b4-992404510398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:22.804175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:22.828826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 671/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:23.112221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a52422-768b-484c-bfa6-f798ffffaeeb None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:23.113787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-07a52422-768b-484c-bfa6-f798ffffaeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:23.216053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a52422-768b-484c-bfa6-f798ffffaeeb None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:23.244427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:23.287983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebfc63-cd7e-4c08-a3fc-be7850496d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:23.288603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebfc63-cd7e-4c08-a3fc-be7850496d65 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:23.288881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebfc63-cd7e-4c08-a3fc-be7850496d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:23.289665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebfc63-cd7e-4c08-a3fc-be7850496d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:23.291242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1eebfc63-cd7e-4c08-a3fc-be7850496d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:23.396588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebfc63-cd7e-4c08-a3fc-be7850496d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:23.397955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebfc63-cd7e-4c08-a3fc-be7850496d65 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:23.415772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 666/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:26.016383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd101-e8cd-4e0e-9aa8-39a737fdfade None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:26.016888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd101-e8cd-4e0e-9aa8-39a737fdfade None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:26.016888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd101-e8cd-4e0e-9aa8-39a737fdfade None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:26.018187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 672/1338] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:26.023971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d326c3-5c77-4f13-9439-2ea055a53478 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:26.024408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d326c3-5c77-4f13-9439-2ea055a53478 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:26.024555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d326c3-5c77-4f13-9439-2ea055a53478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:26.090704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-02d326c3-5c77-4f13-9439-2ea055a53478 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:26.091905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-02d326c3-5c77-4f13-9439-2ea055a53478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:26.100259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:26.191819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 667/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:26.481101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd101-e8cd-4e0e-9aa8-39a737fdfade None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:26.482996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6e5cd101-e8cd-4e0e-9aa8-39a737fdfade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:26.595284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd101-e8cd-4e0e-9aa8-39a737fdfade None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:26.669914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95215c5-3d99-4a48-b113-2117c470c5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:26.670511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95215c5-3d99-4a48-b113-2117c470c5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:26.670791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95215c5-3d99-4a48-b113-2117c470c5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:26.671063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95215c5-3d99-4a48-b113-2117c470c5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:26.672690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f95215c5-3d99-4a48-b113-2117c470c5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:26.708053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:26.782144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95215c5-3d99-4a48-b113-2117c470c5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:26.783492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95215c5-3d99-4a48-b113-2117c470c5b4 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:26.801490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 673/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:30.956555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0c5a-bb5f-4baa-85d0-6a69bc68dcfe None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:30.957121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0c5a-bb5f-4baa-85d0-6a69bc68dcfe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:30.957121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0c5a-bb5f-4baa-85d0-6a69bc68dcfe None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:30.958373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 668/1341] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:30.963700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39cb80-5d09-4d63-84b5-73707d808d4e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:30.964187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39cb80-5d09-4d63-84b5-73707d808d4e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:30.964458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39cb80-5d09-4d63-84b5-73707d808d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:31.033198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-fa39cb80-5d09-4d63-84b5-73707d808d4e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:31.034405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-fa39cb80-5d09-4d63-84b5-73707d808d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:31.118412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:31.130286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 674/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:31.411884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f0c5a-bb5f-4baa-85d0-6a69bc68dcfe None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:31.413438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0c9f0c5a-bb5f-4baa-85d0-6a69bc68dcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:31.516910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f0c5a-bb5f-4baa-85d0-6a69bc68dcfe None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:31.557427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:31.594333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228aa03-8b65-4826-a88c-83080f4551d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:31.594932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228aa03-8b65-4826-a88c-83080f4551d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:31.595206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228aa03-8b65-4826-a88c-83080f4551d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:31.595474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228aa03-8b65-4826-a88c-83080f4551d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:31.597082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0228aa03-8b65-4826-a88c-83080f4551d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:31.707766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228aa03-8b65-4826-a88c-83080f4551d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:31.709152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228aa03-8b65-4826-a88c-83080f4551d0 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:31.727127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 669/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:34.466160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169aa3-6195-4307-a114-7d3f6ba681fa None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:34.466745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169aa3-6195-4307-a114-7d3f6ba681fa None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:34.466745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169aa3-6195-4307-a114-7d3f6ba681fa None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:34.468027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 675/1344] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:34.473266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9c43d-723a-4af8-8ad0-9b13f1f71f94 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:34.473680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9c43d-723a-4af8-8ad0-9b13f1f71f94 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:34.473816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9c43d-723a-4af8-8ad0-9b13f1f71f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:34.539703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-03c9c43d-723a-4af8-8ad0-9b13f1f71f94 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:34.540916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-03c9c43d-723a-4af8-8ad0-9b13f1f71f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:34.558595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:34.643047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 670/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:34.930662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa169aa3-6195-4307-a114-7d3f6ba681fa None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:34.932194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-aa169aa3-6195-4307-a114-7d3f6ba681fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:35.037341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa169aa3-6195-4307-a114-7d3f6ba681fa None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:35.115913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836e707-306e-4c9f-bb7a-f923cdcf9d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:35.116471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e707-306e-4c9f-bb7a-f923cdcf9d97 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:35.116750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e707-306e-4c9f-bb7a-f923cdcf9d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:35.117022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e707-306e-4c9f-bb7a-f923cdcf9d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:35.118672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6836e707-306e-4c9f-bb7a-f923cdcf9d97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:35.169355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:35.237808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836e707-306e-4c9f-bb7a-f923cdcf9d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:35.239239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836e707-306e-4c9f-bb7a-f923cdcf9d97 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:35.258080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 676/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:39.621745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734dfd-8dc7-4e4e-9f44-5feebae109f4 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:39.622274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734dfd-8dc7-4e4e-9f44-5feebae109f4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:39.622274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734dfd-8dc7-4e4e-9f44-5feebae109f4 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:39.623785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 671/1347] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:39.629199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cd38e-8f01-4e24-a35b-db17d7b4f00e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:39.630074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cd38e-8f01-4e24-a35b-db17d7b4f00e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:39.630352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cd38e-8f01-4e24-a35b-db17d7b4f00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:39.715627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-691cd38e-8f01-4e24-a35b-db17d7b4f00e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:39.716886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-691cd38e-8f01-4e24-a35b-db17d7b4f00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:39.812328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:39.814573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 677/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:40.100131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734dfd-8dc7-4e4e-9f44-5feebae109f4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:40.101722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9734dfd-8dc7-4e4e-9f44-5feebae109f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:40.202816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734dfd-8dc7-4e4e-9f44-5feebae109f4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:40.250532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:40.275684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031965a4-aa77-408e-a7a1-e3ca770df458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:40.276292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031965a4-aa77-408e-a7a1-e3ca770df458 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:40.276588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031965a4-aa77-408e-a7a1-e3ca770df458 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:40.276855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031965a4-aa77-408e-a7a1-e3ca770df458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:40.278429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-031965a4-aa77-408e-a7a1-e3ca770df458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:40.383839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031965a4-aa77-408e-a7a1-e3ca770df458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:40.385307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031965a4-aa77-408e-a7a1-e3ca770df458 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:40.403278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 672/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:45.319849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ad29-b414-4786-9cb7-b1c084f6ddad None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:45.320366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ad29-b414-4786-9cb7-b1c084f6ddad None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:45.320366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ad29-b414-4786-9cb7-b1c084f6ddad None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:45.322436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 678/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:45.336135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7fc40-52af-430a-a25f-0181556e3102 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:45.336135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7fc40-52af-430a-a25f-0181556e3102 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:45.336135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7fc40-52af-430a-a25f-0181556e3102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:45.436110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a1f7fc40-52af-430a-a25f-0181556e3102 None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:45.437888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a1f7fc40-52af-430a-a25f-0181556e3102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:45.480575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:45.596492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 673/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:20:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:49.779617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7505b-cc31-463c-ac7b-46d0b7031c31 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:49.780172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7505b-cc31-463c-ac7b-46d0b7031c31 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:49.780712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7505b-cc31-463c-ac7b-46d0b7031c31 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:49.782406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 679/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:49.787950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e238d-a433-4aad-bcec-6deedceec58f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:49.788455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e238d-a433-4aad-bcec-6deedceec58f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:49.788754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e238d-a433-4aad-bcec-6deedceec58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:49.874857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8c2e238d-a433-4aad-bcec-6deedceec58f None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:49.876145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8c2e238d-a433-4aad-bcec-6deedceec58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:49.954684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:49.998551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 674/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:20:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:51.377848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40c1c2-a664-41d8-8ef1-9d496db2e5a6 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:51.378366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40c1c2-a664-41d8-8ef1-9d496db2e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:51.378482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40c1c2-a664-41d8-8ef1-9d496db2e5a6 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:51.379743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 680/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:51.384948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaeabf-deb3-4859-884f-cceffbeafe5b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:51.385339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaeabf-deb3-4859-884f-cceffbeafe5b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:51.385500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaeabf-deb3-4859-884f-cceffbeafe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:51.461435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ebcaeabf-deb3-4859-884f-cceffbeafe5b None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:51.462638 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ebcaeabf-deb3-4859-884f-cceffbeafe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:51.568023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 675/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:20:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:55.065536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb24d4-6bf2-43cd-b2c9-6244dbf09476 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:55.066079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb24d4-6bf2-43cd-b2c9-6244dbf09476 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:55.066287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb24d4-6bf2-43cd-b2c9-6244dbf09476 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:55.067734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 681/1356] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:20:55.073895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0cc62-5181-42f7-9fda-d036d2682efa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:55.074342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0cc62-5181-42f7-9fda-d036d2682efa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:55.074488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0cc62-5181-42f7-9fda-d036d2682efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:55.112312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:55.146688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-caf0cc62-5181-42f7-9fda-d036d2682efa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:55.147907 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-caf0cc62-5181-42f7-9fda-d036d2682efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:55.258368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 676/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:55.564858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c083b-b9b2-4ca6-934a-006448dc0594 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:55.565693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c083b-b9b2-4ca6-934a-006448dc0594 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:55.566351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c083b-b9b2-4ca6-934a-006448dc0594 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:55.568477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 682/1358] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 05:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:55.584086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280af06-700e-4347-88f5-d1d459555620 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:55.584480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280af06-700e-4347-88f5-d1d459555620 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:55.584682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280af06-700e-4347-88f5-d1d459555620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:55.670447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1280af06-700e-4347-88f5-d1d459555620 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:55.671873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1280af06-700e-4347-88f5-d1d459555620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:55.724265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:55.798357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 677/1359] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 05:20:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:55.806332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c083b-b9b2-4ca6-934a-006448dc0594 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:55.807921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-593c083b-b9b2-4ca6-934a-006448dc0594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:55.974503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c083b-b9b2-4ca6-934a-006448dc0594 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:56.053129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:56.096678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dbcd7-66b6-4e6c-a588-24149598761e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:56.097328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dbcd7-66b6-4e6c-a588-24149598761e service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:56.097570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dbcd7-66b6-4e6c-a588-24149598761e service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:56.097820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dbcd7-66b6-4e6c-a588-24149598761e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:56.099598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7e9dbcd7-66b6-4e6c-a588-24149598761e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:56.207207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dbcd7-66b6-4e6c-a588-24149598761e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:56.208846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dbcd7-66b6-4e6c-a588-24149598761e service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:56.230288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 683/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:20:58.636800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d427ca-2057-4001-8ed2-4388b5b6162c None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:58.637269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d427ca-2057-4001-8ed2-4388b5b6162c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:58.637269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d427ca-2057-4001-8ed2-4388b5b6162c None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:58.642586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 678/1361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:20:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:20:58.645410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427763e-003c-4997-abee-d96dc02617f9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:58.645801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427763e-003c-4997-abee-d96dc02617f9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:58.645801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427763e-003c-4997-abee-d96dc02617f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:58.722551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5427763e-003c-4997-abee-d96dc02617f9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:20:58.723827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5427763e-003c-4997-abee-d96dc02617f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:58.765671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:58.832321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 684/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:20:59.123206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d427ca-2057-4001-8ed2-4388b5b6162c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:20:59.125107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-97d427ca-2057-4001-8ed2-4388b5b6162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:59.291058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d427ca-2057-4001-8ed2-4388b5b6162c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:20:59.301838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:20:59.437000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4739-3827-45ad-97ec-a27fad26accd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:20:59.437827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4739-3827-45ad-97ec-a27fad26accd service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:20:59.438290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4739-3827-45ad-97ec-a27fad26accd service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:20:59.438732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4739-3827-45ad-97ec-a27fad26accd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:20:59.441085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-22bd4739-3827-45ad-97ec-a27fad26accd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:20:59.546370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd4739-3827-45ad-97ec-a27fad26accd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:20:59.547984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd4739-3827-45ad-97ec-a27fad26accd service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:20:59.566748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 679/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:02.060412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc066-7a67-46fd-bb39-5582c5f93bdf None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:02.060937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc066-7a67-46fd-bb39-5582c5f93bdf None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:02.060937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc066-7a67-46fd-bb39-5582c5f93bdf None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:02.062209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 685/1364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:02.067541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8faea-ee33-49bc-b443-bcee07564678 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:02.068002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8faea-ee33-49bc-b443-bcee07564678 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:02.068096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8faea-ee33-49bc-b443-bcee07564678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:02.084790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:02.142062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-65c8faea-ee33-49bc-b443-bcee07564678 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:02.143266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-65c8faea-ee33-49bc-b443-bcee07564678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:02.242625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 680/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:02.534202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8693-1480-4716-879c-c7a998f08a04 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:02.534485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8693-1480-4716-879c-c7a998f08a04 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:02.534936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca8693-1480-4716-879c-c7a998f08a04 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:02.536254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 686/1366] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 05:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:02.542210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10209e9-86b8-42dd-9d1c-7db34603505d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:02.542504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10209e9-86b8-42dd-9d1c-7db34603505d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:02.542780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10209e9-86b8-42dd-9d1c-7db34603505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:02.627799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c10209e9-86b8-42dd-9d1c-7db34603505d None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:02.629034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c10209e9-86b8-42dd-9d1c-7db34603505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:02.664940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:02.749409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 681/1367] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 05:21:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:02.758377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca8693-1480-4716-879c-c7a998f08a04 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:02.761269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-83ca8693-1480-4716-879c-c7a998f08a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:02.928626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca8693-1480-4716-879c-c7a998f08a04 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:02.948604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:03.045343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e4cf-443f-4cab-b1d7-ddcce7ab1406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:03.045955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e4cf-443f-4cab-b1d7-ddcce7ab1406 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:03.046232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e4cf-443f-4cab-b1d7-ddcce7ab1406 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:03.046503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e4cf-443f-4cab-b1d7-ddcce7ab1406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:03.048075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b2b3e4cf-443f-4cab-b1d7-ddcce7ab1406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:03.143731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3e4cf-443f-4cab-b1d7-ddcce7ab1406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:03.145270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3e4cf-443f-4cab-b1d7-ddcce7ab1406 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:03.164321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 687/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:03.420794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb8fa9-f338-4829-be35-ca8f4415a8ce None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:03.421359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb8fa9-f338-4829-be35-ca8f4415a8ce None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:03.421359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb8fa9-f338-4829-be35-ca8f4415a8ce None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:03.422826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 682/1369] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:21:03.428889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b7b29-afb0-4c26-a2b6-b28add95b31e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:03.429189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b7b29-afb0-4c26-a2b6-b28add95b31e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:03.429443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b7b29-afb0-4c26-a2b6-b28add95b31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:03.462670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:03.500237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-644b7b29-afb0-4c26-a2b6-b28add95b31e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:03.501490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-644b7b29-afb0-4c26-a2b6-b28add95b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:03.613178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 688/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:03.946930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f89beb-03c2-437d-837b-2ef4131e0298 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:03.947216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f89beb-03c2-437d-837b-2ef4131e0298 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:03.947491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f89beb-03c2-437d-837b-2ef4131e0298 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:03.949094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 683/1371] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 05:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:03.953951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571af9c-da9c-4c7c-8186-e77c15c6b7cb None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:03.954237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571af9c-da9c-4c7c-8186-e77c15c6b7cb None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:03.954510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571af9c-da9c-4c7c-8186-e77c15c6b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:04.036692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0571af9c-da9c-4c7c-8186-e77c15c6b7cb None None] MFA Rules not processed for user `0d585fa74ead490abff52d8b03f850fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:04.038620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0571af9c-da9c-4c7c-8186-e77c15c6b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:04.098820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:04.143127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 689/1372] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 05:21:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:04.151686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f89beb-03c2-437d-837b-2ef4131e0298 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:04.153465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a0f89beb-03c2-437d-837b-2ef4131e0298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:04.264857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f89beb-03c2-437d-837b-2ef4131e0298 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:04.314075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:04.354465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027a996-3973-468a-b85f-e47333293a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:04.355055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a996-3973-468a-b85f-e47333293a61 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:04.355359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a996-3973-468a-b85f-e47333293a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:04.355620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a996-3973-468a-b85f-e47333293a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:04.357215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c027a996-3973-468a-b85f-e47333293a61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:04.487052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027a996-3973-468a-b85f-e47333293a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:04.489725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027a996-3973-468a-b85f-e47333293a61 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:04.524328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 684/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:05.416761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af56317-c65f-4735-a9f8-6dcf098afcdb None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:05.417283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af56317-c65f-4735-a9f8-6dcf098afcdb None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:05.417283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af56317-c65f-4735-a9f8-6dcf098afcdb None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:05.418538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 690/1374] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:05.423687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a391d-533f-4955-9d1f-32994ec645f1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:05.423971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a391d-533f-4955-9d1f-32994ec645f1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:05.424242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a391d-533f-4955-9d1f-32994ec645f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:05.488889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a49a391d-533f-4955-9d1f-32994ec645f1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:05.490077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a49a391d-533f-4955-9d1f-32994ec645f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:05.511581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:05.596356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 685/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:05.877888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af56317-c65f-4735-a9f8-6dcf098afcdb None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:05.879393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2af56317-c65f-4735-a9f8-6dcf098afcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:06.043257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af56317-c65f-4735-a9f8-6dcf098afcdb None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:06.099054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:06.165423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea73de-1ade-45da-a182-bc7c75d4db29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:06.166039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea73de-1ade-45da-a182-bc7c75d4db29 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:06.166317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea73de-1ade-45da-a182-bc7c75d4db29 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:06.166588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea73de-1ade-45da-a182-bc7c75d4db29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:06.168173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-baea73de-1ade-45da-a182-bc7c75d4db29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:06.261697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea73de-1ade-45da-a182-bc7c75d4db29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:06.263296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea73de-1ade-45da-a182-bc7c75d4db29 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:06.281787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 691/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:08.511955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025148e2-da8f-41e3-88f0-2c4afd8ca9a6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:08.512867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025148e2-da8f-41e3-88f0-2c4afd8ca9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:08.513145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025148e2-da8f-41e3-88f0-2c4afd8ca9a6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:08.514647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 686/1377] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:08.519725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539992bf-f84c-49ee-88f5-198c5b936249 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:08.520163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539992bf-f84c-49ee-88f5-198c5b936249 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:08.520371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539992bf-f84c-49ee-88f5-198c5b936249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:08.591177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-539992bf-f84c-49ee-88f5-198c5b936249 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:08.592700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-539992bf-f84c-49ee-88f5-198c5b936249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:08.601011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:08.700316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 692/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:08.987466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025148e2-da8f-41e3-88f0-2c4afd8ca9a6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:08.989013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-025148e2-da8f-41e3-88f0-2c4afd8ca9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:09.146902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025148e2-da8f-41e3-88f0-2c4afd8ca9a6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:09.150793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:09.265668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c03cb-c189-49b2-a26a-809ce42db7b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:09.266282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c03cb-c189-49b2-a26a-809ce42db7b0 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:09.266564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c03cb-c189-49b2-a26a-809ce42db7b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:09.266838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c03cb-c189-49b2-a26a-809ce42db7b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:09.268608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ef2c03cb-c189-49b2-a26a-809ce42db7b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:09.360938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c03cb-c189-49b2-a26a-809ce42db7b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:09.362785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c03cb-c189-49b2-a26a-809ce42db7b0 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:09.382443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 687/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:11.572521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef029c00-cbcd-410d-b8b2-5b9cb11506c9 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:11.573041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef029c00-cbcd-410d-b8b2-5b9cb11506c9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:11.573041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef029c00-cbcd-410d-b8b2-5b9cb11506c9 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:11.574535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 693/1380] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:11.579503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef888ff-3919-4c63-b8fb-b3ccae9c892d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:11.579944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef888ff-3919-4c63-b8fb-b3ccae9c892d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:11.580034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef888ff-3919-4c63-b8fb-b3ccae9c892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:11.591971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:11.653673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2ef888ff-3919-4c63-b8fb-b3ccae9c892d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:11.654892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2ef888ff-3919-4c63-b8fb-b3ccae9c892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:11.759672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 688/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:12.063297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef029c00-cbcd-410d-b8b2-5b9cb11506c9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:12.064865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ef029c00-cbcd-410d-b8b2-5b9cb11506c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:12.213466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:12.227388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef029c00-cbcd-410d-b8b2-5b9cb11506c9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:12.368124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163c278-44af-4ac8-94aa-3c6cd221d292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:12.368983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163c278-44af-4ac8-94aa-3c6cd221d292 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:12.369334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163c278-44af-4ac8-94aa-3c6cd221d292 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:12.369680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163c278-44af-4ac8-94aa-3c6cd221d292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:12.372068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5163c278-44af-4ac8-94aa-3c6cd221d292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:12.483200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163c278-44af-4ac8-94aa-3c6cd221d292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:12.484759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163c278-44af-4ac8-94aa-3c6cd221d292 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:12.494651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:12.503489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 694/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:14.768700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37115d5e-8679-4209-a4d6-8b5c3e3730d9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:14.769249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37115d5e-8679-4209-a4d6-8b5c3e3730d9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:14.769249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37115d5e-8679-4209-a4d6-8b5c3e3730d9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:14.770577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 689/1383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:14.775904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e15e4d-2d0f-40f6-bd35-74ec7e28106f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:14.776431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e15e4d-2d0f-40f6-bd35-74ec7e28106f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:14.776431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e15e4d-2d0f-40f6-bd35-74ec7e28106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:14.848488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-b5e15e4d-2d0f-40f6-bd35-74ec7e28106f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:14.849771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b5e15e4d-2d0f-40f6-bd35-74ec7e28106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:14.946526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 695/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:15.233819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37115d5e-8679-4209-a4d6-8b5c3e3730d9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:15.235362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-37115d5e-8679-4209-a4d6-8b5c3e3730d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:15.325053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:15.404840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37115d5e-8679-4209-a4d6-8b5c3e3730d9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:15.540527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4ee43-cf7d-47b3-9bc5-19a56d253448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:15.541098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4ee43-cf7d-47b3-9bc5-19a56d253448 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:15.541399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4ee43-cf7d-47b3-9bc5-19a56d253448 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:15.541690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4ee43-cf7d-47b3-9bc5-19a56d253448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:15.543442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c4a4ee43-cf7d-47b3-9bc5-19a56d253448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:15.604388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:15.647181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4ee43-cf7d-47b3-9bc5-19a56d253448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:15.649031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4ee43-cf7d-47b3-9bc5-19a56d253448 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:15.669122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 690/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:17.938351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2af65-745b-4da8-8993-bf9888c49d06 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:17.938858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2af65-745b-4da8-8993-bf9888c49d06 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:17.938858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2af65-745b-4da8-8993-bf9888c49d06 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:17.940360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 696/1386] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:17.946220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639cc48-90b9-414c-83cd-5f17568cd7c9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:17.946714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639cc48-90b9-414c-83cd-5f17568cd7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:17.946999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639cc48-90b9-414c-83cd-5f17568cd7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:18.016051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d639cc48-90b9-414c-83cd-5f17568cd7c9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:18.017306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d639cc48-90b9-414c-83cd-5f17568cd7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:18.118442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 691/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:18.405848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2af65-745b-4da8-8993-bf9888c49d06 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:18.407558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-60b2af65-745b-4da8-8993-bf9888c49d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:18.486586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:18.557428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2af65-745b-4da8-8993-bf9888c49d06 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:18.669037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c3af-494d-48a9-8249-6e666ec2f800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:18.669643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c3af-494d-48a9-8249-6e666ec2f800 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:18.669923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c3af-494d-48a9-8249-6e666ec2f800 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:18.670195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c3af-494d-48a9-8249-6e666ec2f800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:18.671781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9156c3af-494d-48a9-8249-6e666ec2f800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:18.710940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:18.761771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c3af-494d-48a9-8249-6e666ec2f800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:18.763314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c3af-494d-48a9-8249-6e666ec2f800 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:18.782112 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 697/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:19.747735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03bd3-0770-4ef8-b8e2-129a956f5ba0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:19.748379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03bd3-0770-4ef8-b8e2-129a956f5ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:19.748379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03bd3-0770-4ef8-b8e2-129a956f5ba0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:19.749697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 692/1389] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:19.754938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f7ce-cf64-491d-bce4-4cc3e6b023b3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:19.755908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f7ce-cf64-491d-bce4-4cc3e6b023b3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:19.756143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f7ce-cf64-491d-bce4-4cc3e6b023b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:19.821807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1169f7ce-cf64-491d-bce4-4cc3e6b023b3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:19.823062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1169f7ce-cf64-491d-bce4-4cc3e6b023b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:19.930424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 698/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:20.234635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5340-9251-4098-9d03-970c22adbfc1 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:20.234919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5340-9251-4098-9d03-970c22adbfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:20.235190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5340-9251-4098-9d03-970c22adbfc1 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:20.236582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 693/1391] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 05:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:20.242402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27da2b-f3d2-4b65-8b2f-3add52e7dc85 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:20.242714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27da2b-f3d2-4b65-8b2f-3add52e7dc85 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:20.242994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27da2b-f3d2-4b65-8b2f-3add52e7dc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:20.259039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:20.320078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8f27da2b-f3d2-4b65-8b2f-3add52e7dc85 None None] MFA Rules not processed for user `6d280ee7087f43a3a7e4c4940a8f23af`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:20.321316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8f27da2b-f3d2-4b65-8b2f-3add52e7dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:20.396549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 699/1392] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 05:21:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:20.405403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5340-9251-4098-9d03-970c22adbfc1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:20.406924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4a5a5340-9251-4098-9d03-970c22adbfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:20.438623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:20.513166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5340-9251-4098-9d03-970c22adbfc1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:20.589041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e0e76-6e4a-4011-b9bf-d165fede56a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:20.589691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e0e76-6e4a-4011-b9bf-d165fede56a6 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:20.590012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e0e76-6e4a-4011-b9bf-d165fede56a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:20.590382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e0e76-6e4a-4011-b9bf-d165fede56a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:20.592448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ad9e0e76-6e4a-4011-b9bf-d165fede56a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:20.669548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:20.702024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e0e76-6e4a-4011-b9bf-d165fede56a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:20.703473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e0e76-6e4a-4011-b9bf-d165fede56a6 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:20.721129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 694/1393] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:20.987583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a836d2-7038-47bd-a15c-eb7b2a02800d None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:20.988149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a836d2-7038-47bd-a15c-eb7b2a02800d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:20.988149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a836d2-7038-47bd-a15c-eb7b2a02800d None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:20.990299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 700/1394] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:20.995414 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:20.995832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:20.995969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:21.064933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:21.066148 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:21.184187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 695/1395] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:21.466042 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35c66-0607-4052-8436-381ef684ca55 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:21.466436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35c66-0607-4052-8436-381ef684ca55 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:21.466799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35c66-0607-4052-8436-381ef684ca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:21.479706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:21.480934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:21.521440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:21.535531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-74f35c66-0607-4052-8436-381ef684ca55 None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:21.536895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-74f35c66-0607-4052-8436-381ef684ca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:21.593679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:21.608713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572ca66-1ee8-4de5-a1d3-59c80232b1f1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:21.631972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 701/1396] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:21:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:21.674506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4df30-1dbf-4581-b75b-e6ccb34c52de None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:21.674817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4df30-1dbf-4581-b75b-e6ccb34c52de None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:21.675092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4df30-1dbf-4581-b75b-e6ccb34c52de None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:21.676607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 702/1397] 10.222.0.27 () {54 vars in 943 bytes} [Wed Sep 21 05:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:21:21.683578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9393-a9ca-40eb-b474-655da66bd7d3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:21.683862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9393-a9ca-40eb-b474-655da66bd7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:21.684135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9393-a9ca-40eb-b474-655da66bd7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:21.727053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:21.727664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:21.727945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:21.728218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:21.729852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:21.759545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-509b9393-a9ca-40eb-b474-655da66bd7d3 None None] MFA Rules not processed for user `1bc038af597c45648f6603d2ef6d685c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:21.760950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-509b9393-a9ca-40eb-b474-655da66bd7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:21.766091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:21.824040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:21.825691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:21.843618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 696/1398] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:21:21.871572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 703/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Sep 21 05:21:21 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:21:21.881881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:21.883115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:21.987934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de78f-5563-444d-8b89-98bd266812b7 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:22.060613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:22.103442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e8bc2-846c-41fb-a523-01099d273440 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:22.104601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e8bc2-846c-41fb-a523-01099d273440 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:22.104878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e8bc2-846c-41fb-a523-01099d273440 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:22.105147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e8bc2-846c-41fb-a523-01099d273440 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:22.106752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ec9e8bc2-846c-41fb-a523-01099d273440 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:22.189837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e8bc2-846c-41fb-a523-01099d273440 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:22.191342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e8bc2-846c-41fb-a523-01099d273440 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:22.199411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 697/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:21:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:21:24.065202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b11ac-ea33-413c-8200-125d47a967fa None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:24.065720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b11ac-ea33-413c-8200-125d47a967fa None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:24.065720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b11ac-ea33-413c-8200-125d47a967fa None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:24.066997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 704/1401] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:24.072385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb9e1-9648-425e-8f78-d2c5e3e7aa09 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:24.072812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb9e1-9648-425e-8f78-d2c5e3e7aa09 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:24.072956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb9e1-9648-425e-8f78-d2c5e3e7aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:24.176092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d54bb9e1-9648-425e-8f78-d2c5e3e7aa09 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:24.176092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d54bb9e1-9648-425e-8f78-d2c5e3e7aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:24.255157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:24.323203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 698/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:21:24.611387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b11ac-ea33-413c-8200-125d47a967fa None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:24.612942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5d0b11ac-ea33-413c-8200-125d47a967fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:24.646556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:24.774531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b11ac-ea33-413c-8200-125d47a967fa None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:24.889207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:24.902252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044cb8c-880e-4a91-b69e-e72163974772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:24.902861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044cb8c-880e-4a91-b69e-e72163974772 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:24.903140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044cb8c-880e-4a91-b69e-e72163974772 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:24.903410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044cb8c-880e-4a91-b69e-e72163974772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:24.905048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e044cb8c-880e-4a91-b69e-e72163974772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:25.006573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044cb8c-880e-4a91-b69e-e72163974772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:25.008412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044cb8c-880e-4a91-b69e-e72163974772 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:25.027132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 705/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:27.283332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b62f4-bddf-4fe2-9ed2-2dae2d1f5ac7 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:27.283858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b62f4-bddf-4fe2-9ed2-2dae2d1f5ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:27.283858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b62f4-bddf-4fe2-9ed2-2dae2d1f5ac7 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:27.285356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 699/1404] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:27.291220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497b4b-199b-40cb-9fc6-2c7113897e86 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:27.291685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497b4b-199b-40cb-9fc6-2c7113897e86 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:27.291789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497b4b-199b-40cb-9fc6-2c7113897e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:27.360258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a8497b4b-199b-40cb-9fc6-2c7113897e86 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:27.361635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a8497b4b-199b-40cb-9fc6-2c7113897e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:27.433434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:27.474547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 706/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:27.762636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b62f4-bddf-4fe2-9ed2-2dae2d1f5ac7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:27.764182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-325b62f4-bddf-4fe2-9ed2-2dae2d1f5ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:27.954189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b62f4-bddf-4fe2-9ed2-2dae2d1f5ac7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:27.999207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:28.090504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0caa3f-c5fd-41ec-9ba7-bb43f98d6267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:28.091111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0caa3f-c5fd-41ec-9ba7-bb43f98d6267 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:28.091394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0caa3f-c5fd-41ec-9ba7-bb43f98d6267 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:28.091672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0caa3f-c5fd-41ec-9ba7-bb43f98d6267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:28.093442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ad0caa3f-c5fd-41ec-9ba7-bb43f98d6267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:28.192220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0caa3f-c5fd-41ec-9ba7-bb43f98d6267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:28.194045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0caa3f-c5fd-41ec-9ba7-bb43f98d6267 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:28.213298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 700/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:30.419401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b46b1-67ea-46b8-8aa2-d4659a6beacd None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:30.419982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b46b1-67ea-46b8-8aa2-d4659a6beacd None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:30.419982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b46b1-67ea-46b8-8aa2-d4659a6beacd None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:30.421556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 707/1407] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:30.426426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68f4ac-3909-4ca7-849a-5efb59bf62dc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:30.426817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68f4ac-3909-4ca7-849a-5efb59bf62dc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:30.427045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68f4ac-3909-4ca7-849a-5efb59bf62dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:30.482978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:30.498042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6f68f4ac-3909-4ca7-849a-5efb59bf62dc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:30.499326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6f68f4ac-3909-4ca7-849a-5efb59bf62dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:30.611704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 701/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:30.903499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b46b1-67ea-46b8-8aa2-d4659a6beacd None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:30.905058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-497b46b1-67ea-46b8-8aa2-d4659a6beacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:31.074098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b46b1-67ea-46b8-8aa2-d4659a6beacd None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:31.137857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:31.206989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f9c93-12bb-45ba-9df2-bf22fec4e797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:31.207629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9c93-12bb-45ba-9df2-bf22fec4e797 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:31.207935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9c93-12bb-45ba-9df2-bf22fec4e797 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:31.208214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9c93-12bb-45ba-9df2-bf22fec4e797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:31.209863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-198f9c93-12bb-45ba-9df2-bf22fec4e797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:31.307017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f9c93-12bb-45ba-9df2-bf22fec4e797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:31.308675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f9c93-12bb-45ba-9df2-bf22fec4e797 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:31.328860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 708/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:40.609861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=46 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:41.326628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=76 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:44.978019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480ab1-0287-4392-ae93-5dc6f516e566 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:44.978573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480ab1-0287-4392-ae93-5dc6f516e566 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:44.978573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480ab1-0287-4392-ae93-5dc6f516e566 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:44.979893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 702/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 21 05:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:44.984993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ef762-c1f1-4682-b546-bca086146f94 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:44.985387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ef762-c1f1-4682-b546-bca086146f94 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:44.985543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ef762-c1f1-4682-b546-bca086146f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:45.061303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-063ef762-c1f1-4682-b546-bca086146f94 None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:45.062512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-063ef762-c1f1-4682-b546-bca086146f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:45.168851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 709/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 21 05:21:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:45.182951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d10c0-3fd4-4128-8674-0d50eb4377a8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:45.183337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d10c0-3fd4-4128-8674-0d50eb4377a8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:45.183620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d10c0-3fd4-4128-8674-0d50eb4377a8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:45.184976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 703/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 21 05:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:45.189744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf57e-7c3c-4ccf-887c-6610d176f2a1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:45.190028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf57e-7c3c-4ccf-887c-6610d176f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:45.190301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf57e-7c3c-4ccf-887c-6610d176f2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:45.261003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:45.264414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-34bbf57e-7c3c-4ccf-887c-6610d176f2a1 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:45.266517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-34bbf57e-7c3c-4ccf-887c-6610d176f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:45.378631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 710/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 21 05:21:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:47.943897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d18fd-e004-4ec9-8253-2816f2dbe26e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:47.944437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d18fd-e004-4ec9-8253-2816f2dbe26e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:47.944437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d18fd-e004-4ec9-8253-2816f2dbe26e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:47.945745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:47.950908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d444-fc73-4115-95fd-29042ce4b468 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:47.951358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d444-fc73-4115-95fd-29042ce4b468 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:47.951464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d444-fc73-4115-95fd-29042ce4b468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:48.017462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-b522d444-fc73-4115-95fd-29042ce4b468 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:48.018671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b522d444-fc73-4115-95fd-29042ce4b468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:48.072730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:48.113857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:48.404370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d18fd-e004-4ec9-8253-2816f2dbe26e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:48.406012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-523d18fd-e004-4ec9-8253-2816f2dbe26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:48.549147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d18fd-e004-4ec9-8253-2816f2dbe26e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:48.621008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:48.661488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f3de-9d5d-4c31-b75c-d0fe7b284203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:48.662093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f3de-9d5d-4c31-b75c-d0fe7b284203 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:48.662369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f3de-9d5d-4c31-b75c-d0fe7b284203 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:48.662637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f3de-9d5d-4c31-b75c-d0fe7b284203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:48.664231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c825f3de-9d5d-4c31-b75c-d0fe7b284203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:48.753166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f3de-9d5d-4c31-b75c-d0fe7b284203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:48.755269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f3de-9d5d-4c31-b75c-d0fe7b284203 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:48.773124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 705/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:49.904579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183f2a6-c1b5-4691-832d-262b4b7f6636 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:49.905058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183f2a6-c1b5-4691-832d-262b4b7f6636 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:49.905160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183f2a6-c1b5-4691-832d-262b4b7f6636 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:49.906521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:49.913531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4e70-91a6-498d-ace6-aadb63db85b0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:49.913943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4e70-91a6-498d-ace6-aadb63db85b0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:49.914076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4e70-91a6-498d-ace6-aadb63db85b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:49.991041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e86d4e70-91a6-498d-ace6-aadb63db85b0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:49.992182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e86d4e70-91a6-498d-ace6-aadb63db85b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:50.018366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:50.087189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:50.235470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183f2a6-c1b5-4691-832d-262b4b7f6636 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:50.237010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a183f2a6-c1b5-4691-832d-262b4b7f6636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:50.380199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183f2a6-c1b5-4691-832d-262b4b7f6636 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:50.420590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:50.492833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08213c10-fa3c-4664-88bc-ff167959baa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:50.493446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213c10-fa3c-4664-88bc-ff167959baa5 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:50.493726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213c10-fa3c-4664-88bc-ff167959baa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:50.493998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213c10-fa3c-4664-88bc-ff167959baa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:50.495601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-08213c10-fa3c-4664-88bc-ff167959baa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:50.583807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08213c10-fa3c-4664-88bc-ff167959baa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:50.585412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08213c10-fa3c-4664-88bc-ff167959baa5 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:50.603480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 713/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:51.729230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931878-f351-4420-aac2-1e047e4e476e None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:51.729689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931878-f351-4420-aac2-1e047e4e476e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:51.729802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931878-f351-4420-aac2-1e047e4e476e None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:51.731104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:51.737281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c787850-6657-43ad-8e2d-500169109fb9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:51.737682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c787850-6657-43ad-8e2d-500169109fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:51.737836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c787850-6657-43ad-8e2d-500169109fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:51.791264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:51.812477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1c787850-6657-43ad-8e2d-500169109fb9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:51.813683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1c787850-6657-43ad-8e2d-500169109fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:51.909228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:52.061411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49931878-f351-4420-aac2-1e047e4e476e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:52.062888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-49931878-f351-4420-aac2-1e047e4e476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:52.206808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49931878-f351-4420-aac2-1e047e4e476e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:52.218564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:52.317622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd5895-f43a-4d2c-ae39-34fa2fdf97f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:52.318122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5895-f43a-4d2c-ae39-34fa2fdf97f5 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:52.318397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5895-f43a-4d2c-ae39-34fa2fdf97f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:52.318664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5895-f43a-4d2c-ae39-34fa2fdf97f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:52.320232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7bdd5895-f43a-4d2c-ae39-34fa2fdf97f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:52.407316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd5895-f43a-4d2c-ae39-34fa2fdf97f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:52.409008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd5895-f43a-4d2c-ae39-34fa2fdf97f5 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:52.435624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 708/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:53.549874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfec0-9ec0-4621-a7bd-0355be210f41 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:53.550442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfec0-9ec0-4621-a7bd-0355be210f41 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:53.550442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfec0-9ec0-4621-a7bd-0355be210f41 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:53.552293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:53.558548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81108d-6605-4d2f-ae3d-6e56cf4722aa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:53.558939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81108d-6605-4d2f-ae3d-6e56cf4722aa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:53.559091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81108d-6605-4d2f-ae3d-6e56cf4722aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:53.578993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:53.635685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-aa81108d-6605-4d2f-ae3d-6e56cf4722aa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:53.636889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aa81108d-6605-4d2f-ae3d-6e56cf4722aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:53.730550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:53.887134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccfec0-9ec0-4621-a7bd-0355be210f41 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:53.888701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a1ccfec0-9ec0-4621-a7bd-0355be210f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:53.998660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:54.034785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccfec0-9ec0-4621-a7bd-0355be210f41 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:54.148061 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eb18b-5751-450f-a0dc-04f9708ad4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:54.148622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb18b-5751-450f-a0dc-04f9708ad4fe service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:54.148903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb18b-5751-450f-a0dc-04f9708ad4fe service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:54.149178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb18b-5751-450f-a0dc-04f9708ad4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:54.150762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-373eb18b-5751-450f-a0dc-04f9708ad4fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:54.224932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:54.238396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eb18b-5751-450f-a0dc-04f9708ad4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:54.240601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eb18b-5751-450f-a0dc-04f9708ad4fe service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:54.258364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 716/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:55.372919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c941b9f-fc72-47bc-ab8d-dda27fb7fba3 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:55.373359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c941b9f-fc72-47bc-ab8d-dda27fb7fba3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:55.373462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c941b9f-fc72-47bc-ab8d-dda27fb7fba3 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:55.374809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:55.381497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d6bb-67c3-4c74-b308-5625863beb9d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:55.381915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d6bb-67c3-4c74-b308-5625863beb9d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:55.382041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d6bb-67c3-4c74-b308-5625863beb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:55.455320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ef99d6bb-67c3-4c74-b308-5625863beb9d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:55.456472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ef99d6bb-67c3-4c74-b308-5625863beb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:55.550260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:55.701877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c941b9f-fc72-47bc-ab8d-dda27fb7fba3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:55.703485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1c941b9f-fc72-47bc-ab8d-dda27fb7fba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:55.786311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:55.848154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c941b9f-fc72-47bc-ab8d-dda27fb7fba3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:55.957616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6170dc-7c8d-480c-b650-7145be822057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:55.958242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6170dc-7c8d-480c-b650-7145be822057 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:55.958528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6170dc-7c8d-480c-b650-7145be822057 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:55.958794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6170dc-7c8d-480c-b650-7145be822057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:55.960398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3b6170dc-7c8d-480c-b650-7145be822057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:56.008466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:56.048516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6170dc-7c8d-480c-b650-7145be822057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:56.050075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6170dc-7c8d-480c-b650-7145be822057 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:56.068654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 711/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:57.120651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1e510-6915-4742-b488-f59573b8f8e0 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:57.121215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1e510-6915-4742-b488-f59573b8f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:57.121215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1e510-6915-4742-b488-f59573b8f8e0 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:57.122739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:57.129050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a562-f41b-41bc-a5b4-f22cf8e36ff4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:57.129491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a562-f41b-41bc-a5b4-f22cf8e36ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:57.129639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a562-f41b-41bc-a5b4-f22cf8e36ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:57.203470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4730a562-f41b-41bc-a5b4-f22cf8e36ff4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:57.204701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4730a562-f41b-41bc-a5b4-f22cf8e36ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:57.299989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:57.448329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1e510-6915-4742-b488-f59573b8f8e0 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:57.449812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0db1e510-6915-4742-b488-f59573b8f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:57.497742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:57.592853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1e510-6915-4742-b488-f59573b8f8e0 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:57.704734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300508b-b11e-4a62-9cf1-3119621e4650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:57.705284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300508b-b11e-4a62-9cf1-3119621e4650 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:57.705570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300508b-b11e-4a62-9cf1-3119621e4650 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:57.705840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300508b-b11e-4a62-9cf1-3119621e4650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:57.707412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f300508b-b11e-4a62-9cf1-3119621e4650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:57.714446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:57.799647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300508b-b11e-4a62-9cf1-3119621e4650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:57.801847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300508b-b11e-4a62-9cf1-3119621e4650 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:57.819349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 719/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:21:58.868189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbf889-0439-4031-a84e-89bf2fc32456 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:58.868716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbf889-0439-4031-a84e-89bf2fc32456 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:58.868824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbf889-0439-4031-a84e-89bf2fc32456 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:58.870104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:21:58.876562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95d1d-87cd-4f3a-aa06-110105ee9b91 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:58.877009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95d1d-87cd-4f3a-aa06-110105ee9b91 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:58.877127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95d1d-87cd-4f3a-aa06-110105ee9b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:58.952634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-72f95d1d-87cd-4f3a-aa06-110105ee9b91 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:21:58.953843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-72f95d1d-87cd-4f3a-aa06-110105ee9b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:59.021941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:59.049980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:21:59.204324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbf889-0439-4031-a84e-89bf2fc32456 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:21:59.205733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-26bbf889-0439-4031-a84e-89bf2fc32456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:59.223378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:59.349255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbf889-0439-4031-a84e-89bf2fc32456 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:21:59.434393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:21:59.460247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a5e80-8f7a-4474-a318-233bcc2d801a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:21:59.460812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5e80-8f7a-4474-a318-233bcc2d801a service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:21:59.461090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5e80-8f7a-4474-a318-233bcc2d801a service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:21:59.461366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5e80-8f7a-4474-a318-233bcc2d801a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:21:59.462928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3d9a5e80-8f7a-4474-a318-233bcc2d801a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:21:59.548324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a5e80-8f7a-4474-a318-233bcc2d801a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:21:59.549909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a5e80-8f7a-4474-a318-233bcc2d801a service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:21:59.568066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 714/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:00.625412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ef89-3d69-4a10-9667-c05f5b0b4a60 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:00.625984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ef89-3d69-4a10-9667-c05f5b0b4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:00.625984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ef89-3d69-4a10-9667-c05f5b0b4a60 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:00.627329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:00.634174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cfa8b-9a0c-4960-99f0-6d428701576a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:00.634629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cfa8b-9a0c-4960-99f0-6d428701576a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:00.634741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cfa8b-9a0c-4960-99f0-6d428701576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:00.710407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b31cfa8b-9a0c-4960-99f0-6d428701576a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:00.711612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b31cfa8b-9a0c-4960-99f0-6d428701576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:00.752695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:00.806104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:00.955314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ef89-3d69-4a10-9667-c05f5b0b4a60 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:00.956816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-dc23ef89-3d69-4a10-9667-c05f5b0b4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:01.105693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ef89-3d69-4a10-9667-c05f5b0b4a60 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:01.159635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:01.217929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2face-cdae-48df-8c4b-05032dbb114d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:01.218458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2face-cdae-48df-8c4b-05032dbb114d service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:01.218740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2face-cdae-48df-8c4b-05032dbb114d service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:01.219013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2face-cdae-48df-8c4b-05032dbb114d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:01.220642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-23b2face-cdae-48df-8c4b-05032dbb114d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:01.309711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2face-cdae-48df-8c4b-05032dbb114d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:01.311317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2face-cdae-48df-8c4b-05032dbb114d service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:01.328780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 722/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:02.376390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bf8f-84e6-4bb7-b0ff-788a405bcc09 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:02.376953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bf8f-84e6-4bb7-b0ff-788a405bcc09 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:02.376953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bf8f-84e6-4bb7-b0ff-788a405bcc09 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:02.378280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:02.384944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd32650-eea3-401b-9570-a674c3cba6d7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:02.385368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd32650-eea3-401b-9570-a674c3cba6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:02.385486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd32650-eea3-401b-9570-a674c3cba6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:02.460241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1fd32650-eea3-401b-9570-a674c3cba6d7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:02.461532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1fd32650-eea3-401b-9570-a674c3cba6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:02.463502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:02.560218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:02.710548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788bf8f-84e6-4bb7-b0ff-788a405bcc09 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:02.711986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f788bf8f-84e6-4bb7-b0ff-788a405bcc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:02.853966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788bf8f-84e6-4bb7-b0ff-788a405bcc09 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:02.883492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:02.967484 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e3236-7cc9-4231-a7e9-10e119bbce24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:02.968008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3236-7cc9-4231-a7e9-10e119bbce24 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:02.968301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3236-7cc9-4231-a7e9-10e119bbce24 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:02.968583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3236-7cc9-4231-a7e9-10e119bbce24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:02.970154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-571e3236-7cc9-4231-a7e9-10e119bbce24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:03.059092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3236-7cc9-4231-a7e9-10e119bbce24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:03.060743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3236-7cc9-4231-a7e9-10e119bbce24 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:03.078081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 717/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:05.113197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65efdc2-02e4-43f9-9775-8fb1a0cd8485 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:05.114262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65efdc2-02e4-43f9-9775-8fb1a0cd8485 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:05.114262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65efdc2-02e4-43f9-9775-8fb1a0cd8485 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:05.115524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:05.121103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795c3f3-fb15-4a8c-bbbd-81c4799f17ce None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:05.121768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795c3f3-fb15-4a8c-bbbd-81c4799f17ce None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:05.121906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795c3f3-fb15-4a8c-bbbd-81c4799f17ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:05.163076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:05.188760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0795c3f3-fb15-4a8c-bbbd-81c4799f17ce None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:05.189997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0795c3f3-fb15-4a8c-bbbd-81c4799f17ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:05.286440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:05.571076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65efdc2-02e4-43f9-9775-8fb1a0cd8485 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:05.572684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f65efdc2-02e4-43f9-9775-8fb1a0cd8485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:05.677258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65efdc2-02e4-43f9-9775-8fb1a0cd8485 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:05.708637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:05.749659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85c863-1ba7-49fe-9cab-adbc4a1ca228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:05.750647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85c863-1ba7-49fe-9cab-adbc4a1ca228 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:05.750923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85c863-1ba7-49fe-9cab-adbc4a1ca228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:05.751191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85c863-1ba7-49fe-9cab-adbc4a1ca228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:05.752797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cb85c863-1ba7-49fe-9cab-adbc4a1ca228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:05.862747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85c863-1ba7-49fe-9cab-adbc4a1ca228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:05.864197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85c863-1ba7-49fe-9cab-adbc4a1ca228 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:05.882594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 725/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:08.164873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cdd6d-1024-47f5-9d49-34fa3cf57541 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:08.165456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cdd6d-1024-47f5-9d49-34fa3cf57541 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:08.165456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cdd6d-1024-47f5-9d49-34fa3cf57541 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:08.166764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:08.172335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5e0c4-c748-4d8f-827f-427ffb2982bc None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:08.172809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5e0c4-c748-4d8f-827f-427ffb2982bc None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:08.172907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5e0c4-c748-4d8f-827f-427ffb2982bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:08.238544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7cf5e0c4-c748-4d8f-827f-427ffb2982bc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:08.239778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7cf5e0c4-c748-4d8f-827f-427ffb2982bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:08.252619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:08.337271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:08.625482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cdd6d-1024-47f5-9d49-34fa3cf57541 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:08.627041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e68cdd6d-1024-47f5-9d49-34fa3cf57541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:08.726291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cdd6d-1024-47f5-9d49-34fa3cf57541 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:08.739398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:08.799076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75298a9-d877-43b8-9a13-be9ef4a5b5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:08.799703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75298a9-d877-43b8-9a13-be9ef4a5b5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:08.799976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75298a9-d877-43b8-9a13-be9ef4a5b5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:08.800245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75298a9-d877-43b8-9a13-be9ef4a5b5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:08.802546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b75298a9-d877-43b8-9a13-be9ef4a5b5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:08.913131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75298a9-d877-43b8-9a13-be9ef4a5b5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:08.914506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75298a9-d877-43b8-9a13-be9ef4a5b5d8 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:08.932580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 720/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:11.456729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067750-4083-41fd-8aca-45535b20f931 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:11.457856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067750-4083-41fd-8aca-45535b20f931 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:11.457966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067750-4083-41fd-8aca-45535b20f931 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:11.459219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:11.464636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657de9a-5610-4cd4-891e-47288d1f462e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:11.465076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657de9a-5610-4cd4-891e-47288d1f462e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:11.465199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657de9a-5610-4cd4-891e-47288d1f462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:11.512412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:11.531141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0657de9a-5610-4cd4-891e-47288d1f462e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:11.532368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0657de9a-5610-4cd4-891e-47288d1f462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:11.629685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:11.912814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73067750-4083-41fd-8aca-45535b20f931 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:11.914342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-73067750-4083-41fd-8aca-45535b20f931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:12.014752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73067750-4083-41fd-8aca-45535b20f931 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:12.054546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:12.087589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d830-02a8-418f-9d04-80206fe40c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:12.088193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d830-02a8-418f-9d04-80206fe40c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:12.088500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d830-02a8-418f-9d04-80206fe40c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:12.088778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d830-02a8-418f-9d04-80206fe40c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:12.090360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7f57d830-02a8-418f-9d04-80206fe40c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:12.196363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d830-02a8-418f-9d04-80206fe40c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:12.197738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d830-02a8-418f-9d04-80206fe40c46 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:12.215589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 728/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:14.476577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e824-04f9-4c94-a39b-466b071185e9 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:14.477112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e824-04f9-4c94-a39b-466b071185e9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:14.477112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e824-04f9-4c94-a39b-466b071185e9 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:14.478465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:14.483735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055487b-f1dd-4c1b-8e1d-616ce94c5ee3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:14.484183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055487b-f1dd-4c1b-8e1d-616ce94c5ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:14.484328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055487b-f1dd-4c1b-8e1d-616ce94c5ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:14.549733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-2055487b-f1dd-4c1b-8e1d-616ce94c5ee3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:14.551452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2055487b-f1dd-4c1b-8e1d-616ce94c5ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:14.572244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:14.648677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:14.933418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914e824-04f9-4c94-a39b-466b071185e9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:14.934947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9914e824-04f9-4c94-a39b-466b071185e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:15.036699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914e824-04f9-4c94-a39b-466b071185e9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:15.057009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:15.108527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07b42-0cc9-4c29-9203-de2cf6073c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:15.109206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07b42-0cc9-4c29-9203-de2cf6073c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:15.109406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07b42-0cc9-4c29-9203-de2cf6073c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:15.109674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07b42-0cc9-4c29-9203-de2cf6073c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:15.111244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bed07b42-0cc9-4c29-9203-de2cf6073c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:15.215514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07b42-0cc9-4c29-9203-de2cf6073c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:15.216973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07b42-0cc9-4c29-9203-de2cf6073c12 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:15.234766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 723/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:22:17.442331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0055ef-94ca-41d5-8294-b53c84b98f70 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:17.442921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0055ef-94ca-41d5-8294-b53c84b98f70 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:17.442921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0055ef-94ca-41d5-8294-b53c84b98f70 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:17.444196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:17.449389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6fca-5568-4280-844a-54ecf99f4ee0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:17.449801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6fca-5568-4280-844a-54ecf99f4ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:17.449936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6fca-5568-4280-844a-54ecf99f4ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:17.512512 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:17.515286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bece6fca-5568-4280-844a-54ecf99f4ee0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:17.517110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bece6fca-5568-4280-844a-54ecf99f4ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:17.610539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:17.891752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0055ef-94ca-41d5-8294-b53c84b98f70 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:17.893382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-af0055ef-94ca-41d5-8294-b53c84b98f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:17.994034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0055ef-94ca-41d5-8294-b53c84b98f70 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:18.041017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:18.066361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d1a4d-b055-4b41-a9c9-03ec433f12c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:18.066972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1a4d-b055-4b41-a9c9-03ec433f12c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:18.067253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1a4d-b055-4b41-a9c9-03ec433f12c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:18.067526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1a4d-b055-4b41-a9c9-03ec433f12c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:18.069161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-342d1a4d-b055-4b41-a9c9-03ec433f12c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:18.175165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d1a4d-b055-4b41-a9c9-03ec433f12c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:18.177190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d1a4d-b055-4b41-a9c9-03ec433f12c8 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:18.195090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 731/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:20.454503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13469-1c62-4f16-91ee-7f1ed4f92ac7 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:20.455093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13469-1c62-4f16-91ee-7f1ed4f92ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:20.455093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13469-1c62-4f16-91ee-7f1ed4f92ac7 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:20.456441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:20.461916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f0caf-34a2-4020-a1d5-6f76b0be8783 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:20.462362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f0caf-34a2-4020-a1d5-6f76b0be8783 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:20.462498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f0caf-34a2-4020-a1d5-6f76b0be8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:20.528118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1c2f0caf-34a2-4020-a1d5-6f76b0be8783 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:20.529344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1c2f0caf-34a2-4020-a1d5-6f76b0be8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:20.557646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:20.625642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:20.924723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd13469-1c62-4f16-91ee-7f1ed4f92ac7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:20.926270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3bd13469-1c62-4f16-91ee-7f1ed4f92ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:21.029797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd13469-1c62-4f16-91ee-7f1ed4f92ac7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:21.057471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:21.104271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a105e-abfe-48d6-9926-8ba0cc8c0c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:21.104905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a105e-abfe-48d6-9926-8ba0cc8c0c74 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:21.105185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a105e-abfe-48d6-9926-8ba0cc8c0c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:21.105458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a105e-abfe-48d6-9926-8ba0cc8c0c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:21.107089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f14a105e-abfe-48d6-9926-8ba0cc8c0c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:21.214156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a105e-abfe-48d6-9926-8ba0cc8c0c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:21.215511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a105e-abfe-48d6-9926-8ba0cc8c0c74 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:21.232889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 726/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:23.492127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c614ee-f305-4d23-9a76-22014780d34a None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:23.492740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c614ee-f305-4d23-9a76-22014780d34a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:23.492740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c614ee-f305-4d23-9a76-22014780d34a None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:23.494045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:23.499466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bd52-350e-4f41-b0f3-006b1b23f10f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:23.499869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bd52-350e-4f41-b0f3-006b1b23f10f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:23.500010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bd52-350e-4f41-b0f3-006b1b23f10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:23.565551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b5a7bd52-350e-4f41-b0f3-006b1b23f10f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:23.567348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b5a7bd52-350e-4f41-b0f3-006b1b23f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:23.578851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:23.671014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:23.960451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c614ee-f305-4d23-9a76-22014780d34a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:23.962005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-15c614ee-f305-4d23-9a76-22014780d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:24.065520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c614ee-f305-4d23-9a76-22014780d34a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:24.119986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:24.138222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd1a9-f06f-482f-9b55-42f58c03fd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:24.138827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd1a9-f06f-482f-9b55-42f58c03fd70 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:24.139106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd1a9-f06f-482f-9b55-42f58c03fd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:24.139375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd1a9-f06f-482f-9b55-42f58c03fd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:24.140983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c18bd1a9-f06f-482f-9b55-42f58c03fd70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:24.248989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd1a9-f06f-482f-9b55-42f58c03fd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:24.250427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd1a9-f06f-482f-9b55-42f58c03fd70 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:24.268214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 734/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:26.445141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43e1e1-8a40-4438-bc35-4bbecf8fabb8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:26.445698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43e1e1-8a40-4438-bc35-4bbecf8fabb8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:26.445698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43e1e1-8a40-4438-bc35-4bbecf8fabb8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:26.447019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:26.452234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10cfc9-7324-4fc0-9f67-7b66db0eed40 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:26.452697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10cfc9-7324-4fc0-9f67-7b66db0eed40 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:26.452803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10cfc9-7324-4fc0-9f67-7b66db0eed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:26.518048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-2d10cfc9-7324-4fc0-9f67-7b66db0eed40 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:26.519779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2d10cfc9-7324-4fc0-9f67-7b66db0eed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:26.557810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:26.616922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:26.901974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43e1e1-8a40-4438-bc35-4bbecf8fabb8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:26.903500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6e43e1e1-8a40-4438-bc35-4bbecf8fabb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:27.006994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43e1e1-8a40-4438-bc35-4bbecf8fabb8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:27.052184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:27.088902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf61bc6-b3b8-475c-90b6-8ab40fb95ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:27.089510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf61bc6-b3b8-475c-90b6-8ab40fb95ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:27.089789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf61bc6-b3b8-475c-90b6-8ab40fb95ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:27.090060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf61bc6-b3b8-475c-90b6-8ab40fb95ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:27.091643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-caf61bc6-b3b8-475c-90b6-8ab40fb95ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:27.206526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf61bc6-b3b8-475c-90b6-8ab40fb95ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:27.208952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf61bc6-b3b8-475c-90b6-8ab40fb95ffd service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:27.226440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 729/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:29.379064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91517-5376-4bd8-98b2-3cad742e9a03 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:29.379625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91517-5376-4bd8-98b2-3cad742e9a03 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:29.379625 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91517-5376-4bd8-98b2-3cad742e9a03 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:29.380975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:29.386138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e17a4-f2ef-4969-ab6c-3761bb055423 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:29.386544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e17a4-f2ef-4969-ab6c-3761bb055423 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:29.386688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e17a4-f2ef-4969-ab6c-3761bb055423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:29.450575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-452e17a4-f2ef-4969-ab6c-3761bb055423 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:29.451761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-452e17a4-f2ef-4969-ab6c-3761bb055423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:29.469499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:29.547483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:29.827754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c91517-5376-4bd8-98b2-3cad742e9a03 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:29.829330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-14c91517-5376-4bd8-98b2-3cad742e9a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:29.932547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c91517-5376-4bd8-98b2-3cad742e9a03 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:29.999491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:30.006776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6f58-6f9f-46e4-8cd1-53192f08a8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:30.007376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6f58-6f9f-46e4-8cd1-53192f08a8ac service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:30.007652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6f58-6f9f-46e4-8cd1-53192f08a8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:30.007917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6f58-6f9f-46e4-8cd1-53192f08a8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:30.009567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-859d6f58-6f9f-46e4-8cd1-53192f08a8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:30.117193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d6f58-6f9f-46e4-8cd1-53192f08a8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:30.118607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d6f58-6f9f-46e4-8cd1-53192f08a8ac service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:30.136151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 737/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:32.289622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15980-ef2f-4861-a231-bc2f7aefabbe None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:32.290181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15980-ef2f-4861-a231-bc2f7aefabbe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:32.290181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15980-ef2f-4861-a231-bc2f7aefabbe None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:32.291500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:32.296801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3ef1d-5653-4f4d-a78a-fce2bf1cadea None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:32.297181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3ef1d-5653-4f4d-a78a-fce2bf1cadea None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:32.297363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3ef1d-5653-4f4d-a78a-fce2bf1cadea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:32.363251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-3bc3ef1d-5653-4f4d-a78a-fce2bf1cadea None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:32.364491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3bc3ef1d-5653-4f4d-a78a-fce2bf1cadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:32.412221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:32.460065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:22:32.745665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb15980-ef2f-4861-a231-bc2f7aefabbe None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:32.747453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2cb15980-ef2f-4861-a231-bc2f7aefabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:32.850433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb15980-ef2f-4861-a231-bc2f7aefabbe None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:32.901128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:32.925247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802f373-8ab5-4486-b9d7-973d9f75a120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:32.925857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f373-8ab5-4486-b9d7-973d9f75a120 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:32.926138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f373-8ab5-4486-b9d7-973d9f75a120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:32.926410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f373-8ab5-4486-b9d7-973d9f75a120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:32.928009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5802f373-8ab5-4486-b9d7-973d9f75a120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:33.152848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802f373-8ab5-4486-b9d7-973d9f75a120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:33.154350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802f373-8ab5-4486-b9d7-973d9f75a120 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:33.171738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 732/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:42.458548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=22 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:43.169560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=66 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:53.146560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93815c0-ca8e-4df2-985e-4c4715d1394b None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:53.147232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93815c0-ca8e-4df2-985e-4c4715d1394b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:53.147232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93815c0-ca8e-4df2-985e-4c4715d1394b None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:53.148456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 739/1471] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:53.153713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770599e-f9a2-452c-98c3-367484424e7d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:53.154119 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770599e-f9a2-452c-98c3-367484424e7d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:53.154251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770599e-f9a2-452c-98c3-367484424e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:53.218136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3770599e-f9a2-452c-98c3-367484424e7d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:53.219315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3770599e-f9a2-452c-98c3-367484424e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:53.314021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 733/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:53.614041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b6be7-af8f-40be-ac59-f8c4c1f42831 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:53.614580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b6be7-af8f-40be-ac59-f8c4c1f42831 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:53.615081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b6be7-af8f-40be-ac59-f8c4c1f42831 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:53.617557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 740/1473] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 05:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:53.625140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043cef6-c579-4869-8ec6-312526b0bd02 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:53.625425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043cef6-c579-4869-8ec6-312526b0bd02 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:53.625694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043cef6-c579-4869-8ec6-312526b0bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:53.700107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8043cef6-c579-4869-8ec6-312526b0bd02 None None] MFA Rules not processed for user `6d280ee7087f43a3a7e4c4940a8f23af`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:53.701324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8043cef6-c579-4869-8ec6-312526b0bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:53.722597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:53.778413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 734/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 05:22:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:53.786799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b6be7-af8f-40be-ac59-f8c4c1f42831 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:53.788338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-583b6be7-af8f-40be-ac59-f8c4c1f42831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:53.890739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b6be7-af8f-40be-ac59-f8c4c1f42831 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:53.963615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0b62c-b12f-4978-a987-c8d8a9f5f347 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:53.964218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b62c-b12f-4978-a987-c8d8a9f5f347 service glance] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:53.964557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b62c-b12f-4978-a987-c8d8a9f5f347 service glance] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:53.964900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b62c-b12f-4978-a987-c8d8a9f5f347 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:53.966534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2bd0b62c-b12f-4978-a987-c8d8a9f5f347 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:54.022722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:54.076529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0b62c-b12f-4978-a987-c8d8a9f5f347 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:54.077996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0b62c-b12f-4978-a987-c8d8a9f5f347 service glance] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:54.096634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 741/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:22:56.386549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144569-9f78-4e73-ae5b-9fceb2d5147a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:56.387106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144569-9f78-4e73-ae5b-9fceb2d5147a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:56.387106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144569-9f78-4e73-ae5b-9fceb2d5147a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:56.388489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 735/1476] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:56.394486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0cad2-0617-45d8-8404-303da86cbed5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:56.394917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0cad2-0617-45d8-8404-303da86cbed5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:56.395019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0cad2-0617-45d8-8404-303da86cbed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:56.461224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-80c0cad2-0617-45d8-8404-303da86cbed5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:56.462441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-80c0cad2-0617-45d8-8404-303da86cbed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:56.560074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 742/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:22:56.838653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144569-9f78-4e73-ae5b-9fceb2d5147a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:56.840167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-56144569-9f78-4e73-ae5b-9fceb2d5147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:56.963456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144569-9f78-4e73-ae5b-9fceb2d5147a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:57.012045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:57.056622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f50574-7392-4dbd-bd12-3dd1c5184d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:57.057224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50574-7392-4dbd-bd12-3dd1c5184d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:57.057501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50574-7392-4dbd-bd12-3dd1c5184d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:57.057770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50574-7392-4dbd-bd12-3dd1c5184d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:57.058396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50574-7392-4dbd-bd12-3dd1c5184d9b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:22:57.060127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-01f50574-7392-4dbd-bd12-3dd1c5184d9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:22:57.060127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:22:57.060127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:22:57.061309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50574-7392-4dbd-bd12-3dd1c5184d9b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:22:57.079419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 736/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 21 05:22:56 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:22:59.229364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6c9f-6fa0-4a8a-a255-05d48b87a6a1 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:59.229893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6c9f-6fa0-4a8a-a255-05d48b87a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:59.229893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6c9f-6fa0-4a8a-a255-05d48b87a6a1 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:59.231172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 743/1479] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:22:59.236611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9668ff-ca21-4d08-ba5a-3490300feb88 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:59.237035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9668ff-ca21-4d08-ba5a-3490300feb88 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:59.237805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9668ff-ca21-4d08-ba5a-3490300feb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:59.303526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fc9668ff-ca21-4d08-ba5a-3490300feb88 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:22:59.304771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fc9668ff-ca21-4d08-ba5a-3490300feb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:59.398637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 737/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:22:59.692465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6c9f-6fa0-4a8a-a255-05d48b87a6a1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:22:59.693984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-823a6c9f-6fa0-4a8a-a255-05d48b87a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:22:59.703773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:59.838200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6c9f-6fa0-4a8a-a255-05d48b87a6a1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:22:59.917376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:22:59.950511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94c6e-22b9-47b1-a20b-7982e7d8e1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:22:59.951055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94c6e-22b9-47b1-a20b-7982e7d8e1d0 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:22:59.951332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94c6e-22b9-47b1-a20b-7982e7d8e1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:22:59.951604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94c6e-22b9-47b1-a20b-7982e7d8e1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:22:59.953241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6ff94c6e-22b9-47b1-a20b-7982e7d8e1d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:00.155177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94c6e-22b9-47b1-a20b-7982e7d8e1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:23:00.156802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94c6e-22b9-47b1-a20b-7982e7d8e1d0 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:23:00.175401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 744/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:23:02.489779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c832f-5bb5-4f5f-8265-0af53a0e90a0 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:02.490313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c832f-5bb5-4f5f-8265-0af53a0e90a0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:02.490313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c832f-5bb5-4f5f-8265-0af53a0e90a0 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:02.491660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 738/1482] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:23:02.496959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f551af-9ef8-4e67-8a2f-08ded9266c50 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:02.497361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f551af-9ef8-4e67-8a2f-08ded9266c50 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:02.497755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f551af-9ef8-4e67-8a2f-08ded9266c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:02.562833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-64f551af-9ef8-4e67-8a2f-08ded9266c50 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:23:02.564030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-64f551af-9ef8-4e67-8a2f-08ded9266c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:02.609693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:02.659239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 745/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:23:02.946520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c832f-5bb5-4f5f-8265-0af53a0e90a0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:23:02.948084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f10c832f-5bb5-4f5f-8265-0af53a0e90a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:02.971059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:03.051684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c832f-5bb5-4f5f-8265-0af53a0e90a0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:23:03.123717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3bf19-5945-4a37-9b6f-23a02911eb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:23:03.124334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bf19-5945-4a37-9b6f-23a02911eb5e service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:03.124612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bf19-5945-4a37-9b6f-23a02911eb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:03.124880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bf19-5945-4a37-9b6f-23a02911eb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:03.126444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b7b3bf19-5945-4a37-9b6f-23a02911eb5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:03.199763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:03.233309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3bf19-5945-4a37-9b6f-23a02911eb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:23:03.234740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3bf19-5945-4a37-9b6f-23a02911eb5e service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:23:03.252774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 739/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:23:05.451175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e8f4-489e-4767-bc68-41eec2df7be5 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:05.451775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e8f4-489e-4767-bc68-41eec2df7be5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:05.451775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e8f4-489e-4767-bc68-41eec2df7be5 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:05.453133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 746/1485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:23:05.458430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33731-5d21-4566-8c99-43ecd1041a42 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:05.458871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33731-5d21-4566-8c99-43ecd1041a42 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:05.459056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33731-5d21-4566-8c99-43ecd1041a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:05.524010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-89c33731-5d21-4566-8c99-43ecd1041a42 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:23:05.525225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-89c33731-5d21-4566-8c99-43ecd1041a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:05.620659 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 740/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:23:05.909513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e8f4-489e-4767-bc68-41eec2df7be5 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:23:05.911084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e962e8f4-489e-4767-bc68-41eec2df7be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:06.012605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e8f4-489e-4767-bc68-41eec2df7be5 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:23:06.083027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:06.084406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3776bea-4946-4379-9e37-b0c1a94cb065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:23:06.085063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3776bea-4946-4379-9e37-b0c1a94cb065 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:06.085530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3776bea-4946-4379-9e37-b0c1a94cb065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:06.085986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3776bea-4946-4379-9e37-b0c1a94cb065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:06.087745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d3776bea-4946-4379-9e37-b0c1a94cb065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:06.194726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3776bea-4946-4379-9e37-b0c1a94cb065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:23:06.196151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3776bea-4946-4379-9e37-b0c1a94cb065 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:23:06.213407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 747/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:23:08.468213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9efa-1ec1-4800-8237-826c0ec56e46 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:08.468815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9efa-1ec1-4800-8237-826c0ec56e46 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:08.468815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9efa-1ec1-4800-8237-826c0ec56e46 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:08.470152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 741/1488] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:23:08.475885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99cc2-efe5-4949-9efa-346be4728a63 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:08.476316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99cc2-efe5-4949-9efa-346be4728a63 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:08.476443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99cc2-efe5-4949-9efa-346be4728a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:08.541013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-36b99cc2-efe5-4949-9efa-346be4728a63 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:23:08.542199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-36b99cc2-efe5-4949-9efa-346be4728a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:08.592574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:08.637146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 748/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:23:08.930859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9efa-1ec1-4800-8237-826c0ec56e46 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:23:08.932421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a27a9efa-1ec1-4800-8237-826c0ec56e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:08.968921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:09.035647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9efa-1ec1-4800-8237-826c0ec56e46 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:23:09.108120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debcdce-ba40-4146-afb0-6348e9fbf634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:23:09.108803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debcdce-ba40-4146-afb0-6348e9fbf634 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:09.109029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debcdce-ba40-4146-afb0-6348e9fbf634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:09.109320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debcdce-ba40-4146-afb0-6348e9fbf634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:09.110883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5debcdce-ba40-4146-afb0-6348e9fbf634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:09.189651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:09.219465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debcdce-ba40-4146-afb0-6348e9fbf634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:23:09.220913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debcdce-ba40-4146-afb0-6348e9fbf634 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:23:09.240163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 742/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:23:11.621356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8899d7-82e7-495a-b658-8d3b06ee660b None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:11.621948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8899d7-82e7-495a-b658-8d3b06ee660b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:11.621948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8899d7-82e7-495a-b658-8d3b06ee660b None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:11.623475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 749/1491] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 21 05:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:23:11.629469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7368f-bb81-4e73-a3b2-b40fa504fe72 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:11.629877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7368f-bb81-4e73-a3b2-b40fa504fe72 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:11.630011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7368f-bb81-4e73-a3b2-b40fa504fe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:11.695380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9cf7368f-bb81-4e73-a3b2-b40fa504fe72 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:23:11.696600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9cf7368f-bb81-4e73-a3b2-b40fa504fe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:11.790199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 743/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 21 05:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:23:12.078913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8899d7-82e7-495a-b658-8d3b06ee660b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:23:12.080561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bc8899d7-82e7-495a-b658-8d3b06ee660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:12.182323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8899d7-82e7-495a-b658-8d3b06ee660b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:23:12.253640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e26d-5e17-45de-b463-1df6b570c0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:23:12.254245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e26d-5e17-45de-b463-1df6b570c0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:23:12.254531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e26d-5e17-45de-b463-1df6b570c0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:23:12.254804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e26d-5e17-45de-b463-1df6b570c0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:23:12.256421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6293e26d-5e17-45de-b463-1df6b570c0e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:23:12.264781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:12.364924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e26d-5e17-45de-b463-1df6b570c0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:23:12.366351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e26d-5e17-45de-b463-1df6b570c0e8 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:23:12.383908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 750/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:23:21.788695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=82 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:23:22.381679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=50 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:24.648738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:24.649415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:24.649415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:24.723167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:24:24.724374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:24.818715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 744/1494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:24:24.826667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0bf5-87ec-4a33-b3af-0abd382eeded None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:24.827154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0bf5-87ec-4a33-b3af-0abd382eeded None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:24.827257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0bf5-87ec-4a33-b3af-0abd382eeded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:24.903570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5aae0bf5-87ec-4a33-b3af-0abd382eeded None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:24:24.904742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5aae0bf5-87ec-4a33-b3af-0abd382eeded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:25.007677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 751/1495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:24:25.012327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:25.013548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:25.025365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1c73-6ce5-4c43-99c7-0ec034b7f5c1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:25.086500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:25.120556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:25.121162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:25.121443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:25.121718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:25.122353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:24:25.122656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:25.123920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:25.123920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:24:25.123920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:24:25.124820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:25.136300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 745/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:24:25.145985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0bf5-87ec-4a33-b3af-0abd382eeded None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:25.156167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0bf5-87ec-4a33-b3af-0abd382eeded None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:25.221562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:25.255614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:25.256220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:25.256541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:25.256812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:25.257446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:25.259158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING py.warnings [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:25.259158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: warnings.warn(msg) Sep 21 05:24:25.259158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: Sep 21 05:24:25.260375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:25.314648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 752/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:24:25 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:24:25.318890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:25.320436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:25.352804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15263-0d1f-459e-adc5-f837a99b6fa2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:25.445550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:25.446066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:25.446342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:25.446608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:25.447220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:25.448226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:25.448226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:24:25.448226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:24:25.449456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:25.491402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 746/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:24:25 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:24:25.495694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:25.497285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:25.561783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e29d52-eba6-468d-8ee4-6106979812a2 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:25.647074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:25.658751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:25.659378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:25.659636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:25.659906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:25.660583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:25.661622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING py.warnings [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:25.661622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: warnings.warn(msg) Sep 21 05:24:25.661622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: Sep 21 05:24:25.662735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:25.675432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 753/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:24:25.681545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:25.683080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:25.694507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68fa72-d92f-49ad-bfd3-2c519b17c600 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:25.720060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:25.790042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa74b09-fd92-43d3-82c2-a0b521746f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:25.790658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74b09-fd92-43d3-82c2-a0b521746f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:25.790964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74b09-fd92-43d3-82c2-a0b521746f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:25.791234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74b09-fd92-43d3-82c2-a0b521746f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:25.791874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa74b09-fd92-43d3-82c2-a0b521746f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:25.792924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-2fa74b09-fd92-43d3-82c2-a0b521746f5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:25.792924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:24:25.792924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:24:25.793847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa74b09-fd92-43d3-82c2-a0b521746f5d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:25.807074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 747/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:24:25.811297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:25.812932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:25.848506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ec18c-c4b7-4e0b-9995-078ca25a64b2 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:25.941583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f51df-1f6f-4e64-b073-27bbc97ecac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:25.942244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f51df-1f6f-4e64-b073-27bbc97ecac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:25.942525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f51df-1f6f-4e64-b073-27bbc97ecac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:25.942797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f51df-1f6f-4e64-b073-27bbc97ecac9 admin admin] PATH_INFO: `/v3/projects/0b2a5982a3084f1982369e7bbfd8ff2d/users/fc0e80258afd4bd9bbee4fb5ed232f43/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:25.964996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f51df-1f6f-4e64-b073-27bbc97ecac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2a5982a3084f1982369e7bbfd8ff2d, user_id=fc0e80258afd4bd9bbee4fb5ed232f43, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:25.966017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING py.warnings [None req-c07f51df-1f6f-4e64-b073-27bbc97ecac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:25.966017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: warnings.warn(msg) Sep 21 05:24:25.966017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: Sep 21 05:24:25.967978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f51df-1f6f-4e64-b073-27bbc97ecac9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:25.993296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 754/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:24:25 2022] PUT /identity/v3/projects/0b2a5982a3084f1982369e7bbfd8ff2d/users/fc0e80258afd4bd9bbee4fb5ed232f43/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:24:26.005577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd989f2-41be-40af-a2ad-b28dff1ce0aa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:26.005871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd989f2-41be-40af-a2ad-b28dff1ce0aa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:26.006153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd989f2-41be-40af-a2ad-b28dff1ce0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:26.062002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2cd989f2-41be-40af-a2ad-b28dff1ce0aa None None] MFA Rules not processed for user `fc0e80258afd4bd9bbee4fb5ed232f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:24:26.063269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2cd989f2-41be-40af-a2ad-b28dff1ce0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:26.141224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 748/1502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:24:26.155322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099131ce-b272-4534-ab00-5fdd56a9ed35 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:26.155633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099131ce-b272-4534-ab00-5fdd56a9ed35 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:26.155908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099131ce-b272-4534-ab00-5fdd56a9ed35 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:26.157264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 755/1503] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 21 05:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:24:26.162027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ad29b-073a-4484-aa20-18cce638b941 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:26.162321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ad29b-073a-4484-aa20-18cce638b941 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:26.162597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ad29b-073a-4484-aa20-18cce638b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:26.193808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:26.238831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-409ad29b-073a-4484-aa20-18cce638b941 None None] MFA Rules not processed for user `0d585fa74ead490abff52d8b03f850fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:24:26.240041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-409ad29b-073a-4484-aa20-18cce638b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:26.313445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 749/1504] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 21 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:24:26.321035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099131ce-b272-4534-ab00-5fdd56a9ed35 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:26.322632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-099131ce-b272-4534-ab00-5fdd56a9ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:26.371780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:26.427301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099131ce-b272-4534-ab00-5fdd56a9ed35 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:26.499785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:26.500415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:26.500698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:26.500972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:26.502555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:26.602703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:26.604143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:26.607612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:26.622684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 756/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:24:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:24:26.668298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a40ff-cc46-4ff9-9536-e490bdd00c70 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:26.668607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a40ff-cc46-4ff9-9536-e490bdd00c70 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:26.668884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a40ff-cc46-4ff9-9536-e490bdd00c70 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:26.670173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 750/1506] 10.222.0.27 () {52 vars in 830 bytes} [Wed Sep 21 05:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:24:26.673712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:26.674961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:26.770085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72749b-39ff-4da1-b909-c6e6ec309cdf service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:26.861812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:26.862444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:26.862724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:26.862996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] PATH_INFO: `/v3/users/fc0e80258afd4bd9bbee4fb5ed232f43` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:26.876814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0e80258afd4bd9bbee4fb5ed232f43)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:26.877824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING py.warnings [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:26.877824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: warnings.warn(msg) Sep 21 05:24:26.877824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: Sep 21 05:24:26.879036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:26.888503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:26.943103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0e80258afd4bd9bbee4fb5ed232f43'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:26.951879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0e80258afd4bd9bbee4fb5ed232f43'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:26.952334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0e80258afd4bd9bbee4fb5ed232f43'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:26.967067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0e80258afd4bd9bbee4fb5ed232f43'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:26.990518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0e80258afd4bd9bbee4fb5ed232f43'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:26.996054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 757/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:24:26 2022] DELETE /identity/v3/users/fc0e80258afd4bd9bbee4fb5ed232f43 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:24:27.000747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:27.001246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:27.001358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:27.057128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:24:27.058419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:27.132667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:27.145098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 751/1508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:24:27.154581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:27.155847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:27.255531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e2605-7718-4006-a8a6-1b6f44578762 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:27.307717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:27.328418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0d60e-7aab-4b71-a046-aad01349a487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:27.329519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d60e-7aab-4b71-a046-aad01349a487 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:27.329799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d60e-7aab-4b71-a046-aad01349a487 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:27.330075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d60e-7aab-4b71-a046-aad01349a487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:27.331662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9ef0d60e-7aab-4b71-a046-aad01349a487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:27.437909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0d60e-7aab-4b71-a046-aad01349a487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:27.439296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0d60e-7aab-4b71-a046-aad01349a487 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:27.457431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 758/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:24:27.783950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:24:27.785267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:24:27.797550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a430c-5d26-4249-a0c3-c988f712a49f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:24:27.904129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:24:27.904803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:24:27.905086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:24:27.905369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] PATH_INFO: `/v3/projects/0b2a5982a3084f1982369e7bbfd8ff2d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:24:27.915045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2a5982a3084f1982369e7bbfd8ff2d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:24:27.916078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:24:27.916078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:24:27.916078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:24:27.917352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:24:27.975914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2a5982a3084f1982369e7bbfd8ff2d', 'request_id': 'req-0e2d0e4b-c284-41f0-a569-781223ea5cf4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:27.981884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2a5982a3084f1982369e7bbfd8ff2d', 'request_id': 'req-0e2d0e4b-c284-41f0-a569-781223ea5cf4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:27.995020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2a5982a3084f1982369e7bbfd8ff2d', 'request_id': 'req-0e2d0e4b-c284-41f0-a569-781223ea5cf4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:28.026063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] The token cache is being invalidate because project 0b2a5982a3084f1982369e7bbfd8ff2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:24:28.026683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:28.026683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e2d0e4b-c284-41f0-a569-781223ea5cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:24:28.028111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 752/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:24:27 2022] DELETE /identity/v3/projects/0b2a5982a3084f1982369e7bbfd8ff2d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:24:37.455146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=62 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:24:38.022803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:26:01.215852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8e7a-946b-41fd-bd1c-062ad151e0ed None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:01.216487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8e7a-946b-41fd-bd1c-062ad151e0ed None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:01.216487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8e7a-946b-41fd-bd1c-062ad151e0ed None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:01.217826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:01.223664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597190-aa1c-4ec5-b5db-dfa1aaf4cf39 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:01.224114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597190-aa1c-4ec5-b5db-dfa1aaf4cf39 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:01.224226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597190-aa1c-4ec5-b5db-dfa1aaf4cf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:01.304753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-52597190-aa1c-4ec5-b5db-dfa1aaf4cf39 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:01.305958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-52597190-aa1c-4ec5-b5db-dfa1aaf4cf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:01.407348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:01.559696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8e7a-946b-41fd-bd1c-062ad151e0ed None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:01.561813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1bce8e7a-946b-41fd-bd1c-062ad151e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:01.679171 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8e7a-946b-41fd-bd1c-062ad151e0ed None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:01.684589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3717c-332c-4a24-beea-1ad14003964b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:01.685194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3717c-332c-4a24-beea-1ad14003964b service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:01.685477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3717c-332c-4a24-beea-1ad14003964b service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:01.685755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3717c-332c-4a24-beea-1ad14003964b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:01.693713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3717c-332c-4a24-beea-1ad14003964b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:01.695303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3717c-332c-4a24-beea-1ad14003964b service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:01.704536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 760/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:02.778384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146f1d-595b-4155-95ed-29eb1c95c74a None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:02.778991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146f1d-595b-4155-95ed-29eb1c95c74a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:02.778991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146f1d-595b-4155-95ed-29eb1c95c74a None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:02.780367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:02.786898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4490b-2254-4e6e-ac0f-91ebe7e74f69 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:02.787305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4490b-2254-4e6e-ac0f-91ebe7e74f69 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:02.787458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4490b-2254-4e6e-ac0f-91ebe7e74f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:02.807190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-14d4490b-2254-4e6e-ac0f-91ebe7e74f69 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:02.808432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-14d4490b-2254-4e6e-ac0f-91ebe7e74f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:02.816588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:02.970103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41146f1d-595b-4155-95ed-29eb1c95c74a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:02.984816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41146f1d-595b-4155-95ed-29eb1c95c74a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:02.990956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340df00-2cda-4201-9d33-0b3338b46440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:02.991576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340df00-2cda-4201-9d33-0b3338b46440 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:02.991852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340df00-2cda-4201-9d33-0b3338b46440 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:02.992122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340df00-2cda-4201-9d33-0b3338b46440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:03.000427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340df00-2cda-4201-9d33-0b3338b46440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:03.002046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340df00-2cda-4201-9d33-0b3338b46440 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:03.011109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 755/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:03.198719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b5fe-96fb-414e-ae09-f9967d0e28a3 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:03.198982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b5fe-96fb-414e-ae09-f9967d0e28a3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:03.199258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b5fe-96fb-414e-ae09-f9967d0e28a3 None None] PATH_INFO: `/v3` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:03.200572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 762/1517] 10.222.0.26 () {54 vars in 925 bytes} [Wed Sep 21 05:26:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:26:03.207511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d65b2-6beb-44d8-84ae-3dc8a7fd3264 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:03.207799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d65b2-6beb-44d8-84ae-3dc8a7fd3264 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:03.208078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d65b2-6beb-44d8-84ae-3dc8a7fd3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:03.266320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-991d65b2-6beb-44d8-84ae-3dc8a7fd3264 None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:03.267525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-991d65b2-6beb-44d8-84ae-3dc8a7fd3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:03.284934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:26:03.339876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 756/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Sep 21 05:26:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:12.360435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bfbe-a025-46c1-9280-6513c28758c1 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:12.360906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bfbe-a025-46c1-9280-6513c28758c1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:12.361101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bfbe-a025-46c1-9280-6513c28758c1 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:12.362425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 763/1519] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 21 05:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:12.367713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42fa04-d2b9-4466-b08f-dac9d87c936a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:12.368123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42fa04-d2b9-4466-b08f-dac9d87c936a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:12.368252 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42fa04-d2b9-4466-b08f-dac9d87c936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:12.388127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fd42fa04-d2b9-4466-b08f-dac9d87c936a None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:12.389371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fd42fa04-d2b9-4466-b08f-dac9d87c936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:12.397732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 757/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 21 05:26:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:12.405017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04bfbe-a025-46c1-9280-6513c28758c1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:12.418958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04bfbe-a025-46c1-9280-6513c28758c1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:12.423802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad9866-b720-4b33-9a47-ccebab10111f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:12.424424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad9866-b720-4b33-9a47-ccebab10111f service placement] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:12.424738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad9866-b720-4b33-9a47-ccebab10111f service placement] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:12.425011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad9866-b720-4b33-9a47-ccebab10111f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:12.433629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad9866-b720-4b33-9a47-ccebab10111f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:12.435197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad9866-b720-4b33-9a47-ccebab10111f service placement] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:12.444571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 764/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:14.477202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e5672-47fe-43e3-a761-eb3d9a3b1029 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:14.477861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e5672-47fe-43e3-a761-eb3d9a3b1029 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:14.477861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e5672-47fe-43e3-a761-eb3d9a3b1029 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:14.479096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:14.485172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa644-56aa-4ad8-aa91-bb079241b03a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:14.485623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa644-56aa-4ad8-aa91-bb079241b03a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:14.485732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa644-56aa-4ad8-aa91-bb079241b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:14.505054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-637fa644-56aa-4ad8-aa91-bb079241b03a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:14.506234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-637fa644-56aa-4ad8-aa91-bb079241b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:14.513835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:14.667892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e5672-47fe-43e3-a761-eb3d9a3b1029 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:14.682106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e5672-47fe-43e3-a761-eb3d9a3b1029 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:14.687485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d18c6e-c1ae-42e3-85e5-f7734f039ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:14.688073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18c6e-c1ae-42e3-85e5-f7734f039ec4 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:14.688405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18c6e-c1ae-42e3-85e5-f7734f039ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:14.688681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18c6e-c1ae-42e3-85e5-f7734f039ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:14.697180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d18c6e-c1ae-42e3-85e5-f7734f039ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:14.698756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d18c6e-c1ae-42e3-85e5-f7734f039ec4 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:14.708064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 759/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:15.778271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3f3e-816e-4cc8-a744-4955f1eec06b None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:15.778876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3f3e-816e-4cc8-a744-4955f1eec06b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:15.778876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3f3e-816e-4cc8-a744-4955f1eec06b None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:15.780236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 05:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:15.786136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ea56-8671-407d-82e1-739213d1b534 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:15.786582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ea56-8671-407d-82e1-739213d1b534 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:15.786715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ea56-8671-407d-82e1-739213d1b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:15.806091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c150ea56-8671-407d-82e1-739213d1b534 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:15.807277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c150ea56-8671-407d-82e1-739213d1b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:15.815117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 05:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:15.974602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac3f3e-816e-4cc8-a744-4955f1eec06b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:15.988714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac3f3e-816e-4cc8-a744-4955f1eec06b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:15.994597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffed37-5e28-408d-8af4-e7dc6a89299b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:15.995189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffed37-5e28-408d-8af4-e7dc6a89299b service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:15.995472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffed37-5e28-408d-8af4-e7dc6a89299b service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:15.995746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffed37-5e28-408d-8af4-e7dc6a89299b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:16.003879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffed37-5e28-408d-8af4-e7dc6a89299b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:16.005486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffed37-5e28-408d-8af4-e7dc6a89299b service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:16.015289 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 767/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:20.037674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909df3-6f2e-4d13-9eca-806780b369b8 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:20.038255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909df3-6f2e-4d13-9eca-806780b369b8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:20.038255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909df3-6f2e-4d13-9eca-806780b369b8 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:20.039588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:20.044783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432393d0-fd16-4eef-a763-f959fab50bdf None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:20.045252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432393d0-fd16-4eef-a763-f959fab50bdf None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:20.045360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432393d0-fd16-4eef-a763-f959fab50bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:20.064533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-432393d0-fd16-4eef-a763-f959fab50bdf None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:20.065724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-432393d0-fd16-4eef-a763-f959fab50bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:20.073975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:20.359794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909df3-6f2e-4d13-9eca-806780b369b8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:20.361497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-46909df3-6f2e-4d13-9eca-806780b369b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:20.437247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909df3-6f2e-4d13-9eca-806780b369b8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:20.440775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4059dd-06eb-4eb4-bfd4-b8e7e42c78c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:20.441374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4059dd-06eb-4eb4-bfd4-b8e7e42c78c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:20.441651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4059dd-06eb-4eb4-bfd4-b8e7e42c78c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:20.441922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4059dd-06eb-4eb4-bfd4-b8e7e42c78c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:20.451668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4059dd-06eb-4eb4-bfd4-b8e7e42c78c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:20.453128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4059dd-06eb-4eb4-bfd4-b8e7e42c78c5 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:20.462270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 762/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:22.574678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb66b-b136-43d6-b5bc-9539fdd64bef None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:22.575256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb66b-b136-43d6-b5bc-9539fdd64bef None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:22.575256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb66b-b136-43d6-b5bc-9539fdd64bef None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:22.576600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:22.581921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf205-2343-4885-a634-888300ad206a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:22.582339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf205-2343-4885-a634-888300ad206a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:22.582451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf205-2343-4885-a634-888300ad206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:22.601613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3fedf205-2343-4885-a634-888300ad206a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:22.602789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3fedf205-2343-4885-a634-888300ad206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:22.610431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:22.897940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb66b-b136-43d6-b5bc-9539fdd64bef None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:22.899641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-25cdb66b-b136-43d6-b5bc-9539fdd64bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:22.912717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb66b-b136-43d6-b5bc-9539fdd64bef None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:22.917148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8a4b-636d-40b9-a023-2be6628f135c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:22.917758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8a4b-636d-40b9-a023-2be6628f135c service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:22.918043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8a4b-636d-40b9-a023-2be6628f135c service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:22.918317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8a4b-636d-40b9-a023-2be6628f135c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:22.927501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8a4b-636d-40b9-a023-2be6628f135c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:22.929645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8a4b-636d-40b9-a023-2be6628f135c service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:22.939284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 770/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:26.605628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9af1e1-cb14-4eab-94fb-3f49c8ac334f None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:26.606193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9af1e1-cb14-4eab-94fb-3f49c8ac334f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:26.606193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9af1e1-cb14-4eab-94fb-3f49c8ac334f None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:26.607544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:26.612915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ced5-3b3d-45ea-a59d-9b104e4c546b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:26.613340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ced5-3b3d-45ea-a59d-9b104e4c546b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:26.613455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ced5-3b3d-45ea-a59d-9b104e4c546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:26.633647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1074ced5-3b3d-45ea-a59d-9b104e4c546b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:26.634842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1074ced5-3b3d-45ea-a59d-9b104e4c546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:26.642736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:26.942520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9af1e1-cb14-4eab-94fb-3f49c8ac334f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:26.944761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3b9af1e1-cb14-4eab-94fb-3f49c8ac334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:27.011248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:26:27.025270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9af1e1-cb14-4eab-94fb-3f49c8ac334f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:27.028852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4819691-1e16-49e7-91a4-00375a580763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:27.029458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4819691-1e16-49e7-91a4-00375a580763 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:27.029737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4819691-1e16-49e7-91a4-00375a580763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:27.030013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4819691-1e16-49e7-91a4-00375a580763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:27.038794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4819691-1e16-49e7-91a4-00375a580763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:27.040228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4819691-1e16-49e7-91a4-00375a580763 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:27.049421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 765/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:29.199583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb2ddc-f924-4a61-9228-41c0d13185ee None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:29.200119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb2ddc-f924-4a61-9228-41c0d13185ee None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:29.200119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb2ddc-f924-4a61-9228-41c0d13185ee None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:29.201408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 05:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:26:29.206567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a782e-9484-4f1d-90f6-289ce8647a60 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:29.206982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a782e-9484-4f1d-90f6-289ce8647a60 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:29.207121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a782e-9484-4f1d-90f6-289ce8647a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:29.226851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5f6a782e-9484-4f1d-90f6-289ce8647a60 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:26:29.228039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5f6a782e-9484-4f1d-90f6-289ce8647a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:29.235773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 05:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:26:29.546488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb2ddc-f924-4a61-9228-41c0d13185ee None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:26:29.548128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a5eb2ddc-f924-4a61-9228-41c0d13185ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:26:29.555520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=84 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:26:29.561745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb2ddc-f924-4a61-9228-41c0d13185ee None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:26:29.565166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becedb5c-9536-40f0-916c-3e3ff35d8f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:26:29.565750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becedb5c-9536-40f0-916c-3e3ff35d8f89 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:26:29.566024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becedb5c-9536-40f0-916c-3e3ff35d8f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:26:29.566293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becedb5c-9536-40f0-916c-3e3ff35d8f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:26:29.574837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becedb5c-9536-40f0-916c-3e3ff35d8f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:26:29.576240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becedb5c-9536-40f0-916c-3e3ff35d8f89 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:26:29.585824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 773/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:26:39.221590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=11 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:26:39.581224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:04.308383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769259a-0f37-4aaa-a191-3aea7d56a0af None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.309065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769259a-0f37-4aaa-a191-3aea7d56a0af None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.309065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769259a-0f37-4aaa-a191-3aea7d56a0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.332016 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3769259a-0f37-4aaa-a191-3aea7d56a0af None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.333443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3769259a-0f37-4aaa-a191-3aea7d56a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.348777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 767/1540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.355199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627533-c501-42df-9c40-ca181224f81f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.355789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627533-c501-42df-9c40-ca181224f81f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.355789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627533-c501-42df-9c40-ca181224f81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.361429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345d850-c30e-4a62-8cec-9a10781e3110 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.361737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345d850-c30e-4a62-8cec-9a10781e3110 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.362056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345d850-c30e-4a62-8cec-9a10781e3110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.394971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5c627533-c501-42df-9c40-ca181224f81f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.395858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5c627533-c501-42df-9c40-ca181224f81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.409585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5345d850-c30e-4a62-8cec-9a10781e3110 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.411662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5345d850-c30e-4a62-8cec-9a10781e3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.419095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 774/1541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.424436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e636-cfd6-4626-a228-ad8657e933a5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.424781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e636-cfd6-4626-a228-ad8657e933a5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.425067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e636-cfd6-4626-a228-ad8657e933a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.437654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 768/1542] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.437654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d659e-23f7-4528-abdf-9468c0fc9f97 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.437654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d659e-23f7-4528-abdf-9468c0fc9f97 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.437654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d659e-23f7-4528-abdf-9468c0fc9f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.462467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7c77e636-cfd6-4626-a228-ad8657e933a5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.463681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7c77e636-cfd6-4626-a228-ad8657e933a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.472522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7a1d659e-23f7-4528-abdf-9468c0fc9f97 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.473686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7a1d659e-23f7-4528-abdf-9468c0fc9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.489190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 775/1543] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.490554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969efe4-a4a2-4684-9251-abd6a3b569e1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.490847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969efe4-a4a2-4684-9251-abd6a3b569e1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.491123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969efe4-a4a2-4684-9251-abd6a3b569e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.501170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 769/1544] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.502060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d659e-23f7-4528-abdf-9468c0fc9f97 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.519984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d659e-23f7-4528-abdf-9468c0fc9f97 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.525535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aae1a-5fd5-44cb-91fa-ea9bc54102ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.526260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aae1a-5fd5-44cb-91fa-ea9bc54102ac admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.526544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aae1a-5fd5-44cb-91fa-ea9bc54102ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.526822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aae1a-5fd5-44cb-91fa-ea9bc54102ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.527465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aae1a-5fd5-44cb-91fa-ea9bc54102ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:04.527767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aae1a-5fd5-44cb-91fa-ea9bc54102ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.529422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aae1a-5fd5-44cb-91fa-ea9bc54102ac admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.533199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6969efe4-a4a2-4684-9251-abd6a3b569e1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.534420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6969efe4-a4a2-4684-9251-abd6a3b569e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.551647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 776/1545] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.553230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591402-f64b-41df-ab4a-a4374b268a22 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.553518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591402-f64b-41df-ab4a-a4374b268a22 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.553834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591402-f64b-41df-ab4a-a4374b268a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.560705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 770/1546] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:04.561964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf058-7e55-4a7a-953b-4a771b3562a6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.562255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf058-7e55-4a7a-953b-4a771b3562a6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.562538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf058-7e55-4a7a-953b-4a771b3562a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.582597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-18591402-f64b-41df-ab4a-a4374b268a22 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.583813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-18591402-f64b-41df-ab4a-a4374b268a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.587634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e0abf058-7e55-4a7a-953b-4a771b3562a6 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.588892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e0abf058-7e55-4a7a-953b-4a771b3562a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.593486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 777/1547] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.594801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6ae9a-4a15-43b1-862e-3b47aa8dcb7a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.595090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6ae9a-4a15-43b1-862e-3b47aa8dcb7a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.595371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6ae9a-4a15-43b1-862e-3b47aa8dcb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.597560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 771/1548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.599108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2847cde-eaac-48f8-b4cb-5f1c884fd69a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.599412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2847cde-eaac-48f8-b4cb-5f1c884fd69a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.599686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2847cde-eaac-48f8-b4cb-5f1c884fd69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.617714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8fc6ae9a-4a15-43b1-862e-3b47aa8dcb7a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.618913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8fc6ae9a-4a15-43b1-862e-3b47aa8dcb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.619302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d2847cde-eaac-48f8-b4cb-5f1c884fd69a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.620489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d2847cde-eaac-48f8-b4cb-5f1c884fd69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.627009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 778/1549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.629542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6ae9a-4a15-43b1-862e-3b47aa8dcb7a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.629677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 772/1550] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.629771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5798-a87f-47a1-98db-e86e9f3d6129 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.630047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5798-a87f-47a1-98db-e86e9f3d6129 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.630324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5798-a87f-47a1-98db-e86e9f3d6129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.637332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6ae9a-4a15-43b1-862e-3b47aa8dcb7a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.642841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.643439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.643720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.643991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.644676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:04.644980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.645988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING py.warnings [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:28:04.645988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: warnings.warn(msg) Sep 21 05:28:04.645988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: Sep 21 05:28:04.646878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.651283 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-964b5798-a87f-47a1-98db-e86e9f3d6129 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.652598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-964b5798-a87f-47a1-98db-e86e9f3d6129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.659006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 779/1551] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:04.659772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.660911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 773/1552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.661951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8226e-972c-4b16-9fd5-5ef2010f8a7a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.662237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8226e-972c-4b16-9fd5-5ef2010f8a7a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.662509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8226e-972c-4b16-9fd5-5ef2010f8a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.677370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6354d-4e94-4a09-bb72-5032fc293789 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.682000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.682320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-50a8226e-972c-4b16-9fd5-5ef2010f8a7a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.682593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.682872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.683143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.683509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-50a8226e-972c-4b16-9fd5-5ef2010f8a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.683763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.685708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.691309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 774/1553] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.692585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b88c-78c3-4a8f-ae18-73df48f1e4b9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.692891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b88c-78c3-4a8f-ae18-73df48f1e4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.693185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b88c-78c3-4a8f-ae18-73df48f1e4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.712321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-48b1b88c-78c3-4a8f-ae18-73df48f1e4b9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.713631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48b1b88c-78c3-4a8f-ae18-73df48f1e4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.721794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 775/1554] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.722564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1b88c-78c3-4a8f-ae18-73df48f1e4b9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.723013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 780/1555] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:04.723830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.732327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1b88c-78c3-4a8f-ae18-73df48f1e4b9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.795087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332204fb-f09f-4ef3-893a-5ab5eee32bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.795623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f0445-9aeb-4d21-8dbc-7ed92d98de05 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.795769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332204fb-f09f-4ef3-893a-5ab5eee32bea admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.796157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332204fb-f09f-4ef3-893a-5ab5eee32bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.796467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332204fb-f09f-4ef3-893a-5ab5eee32bea admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.797109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332204fb-f09f-4ef3-893a-5ab5eee32bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:04.797410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332204fb-f09f-4ef3-893a-5ab5eee32bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.799069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332204fb-f09f-4ef3-893a-5ab5eee32bea admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.800501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.801106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.801400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.801887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.802323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:04.802626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.804237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.810302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 776/1556] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:04.811612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616ec9-d1cb-4596-b104-6827aa4ba856 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.811839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616ec9-d1cb-4596-b104-6827aa4ba856 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.812112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616ec9-d1cb-4596-b104-6827aa4ba856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.823413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 781/1557] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:04.824476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.831921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-06616ec9-d1cb-4596-b104-6827aa4ba856 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.833132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-06616ec9-d1cb-4596-b104-6827aa4ba856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.834499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1d36d-4092-43fb-87a1-91aa71a51e75 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.839667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f12ba-4938-4455-9735-4837ab0fb5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.840256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f12ba-4938-4455-9735-4837ab0fb5db admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.840681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f12ba-4938-4455-9735-4837ab0fb5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.840959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f12ba-4938-4455-9735-4837ab0fb5db admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.842448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 777/1558] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.842576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f12ba-4938-4455-9735-4837ab0fb5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.844939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41501b9-4307-4857-8252-416e11bbee27 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.844939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41501b9-4307-4857-8252-416e11bbee27 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.844939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41501b9-4307-4857-8252-416e11bbee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.845245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f12ba-4938-4455-9735-4837ab0fb5db admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.864270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e41501b9-4307-4857-8252-416e11bbee27 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.865705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e41501b9-4307-4857-8252-416e11bbee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.875447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 782/1559] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:04.875447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c4506-10df-48f0-a6a3-49a863473e93 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.875709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 778/1560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.875802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c4506-10df-48f0-a6a3-49a863473e93 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.875802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c4506-10df-48f0-a6a3-49a863473e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.875960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41501b9-4307-4857-8252-416e11bbee27 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.885975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41501b9-4307-4857-8252-416e11bbee27 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.894322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-780c4506-10df-48f0-a6a3-49a863473e93 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:04.895518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-780c4506-10df-48f0-a6a3-49a863473e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:04.940648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.941261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.941543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.941816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.942183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:04.942450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:04.942749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.944897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.955053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 783/1561] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:04.955852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c4506-10df-48f0-a6a3-49a863473e93 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.964411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 779/1562] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:04.964411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:04.970388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c4506-10df-48f0-a6a3-49a863473e93 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.973376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c615031-6eec-4e3f-b758-fa2f8d5087da admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:04.975347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.975998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.976297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.976582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.977218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.978275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING py.warnings [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:28:04.978275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: warnings.warn(msg) Sep 21 05:28:04.978275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: Sep 21 05:28:04.978512 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:04.978907 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:04.979261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:04.979488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:04.979643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.980254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:04.981488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:28:04.981488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:28:04.981488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:28:04.982691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:04.988334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:05.001075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 784/1563] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.001895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.012357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328dad1-ce86-4cc8-91e5-ed436401b371 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.014276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 780/1564] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:04 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.015048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.075858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.076397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.076683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.076961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.077079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3926d-670c-4160-aada-f5341aaacc96 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.077594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.079511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.081590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.082189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.082468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.082737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.083369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:05.083666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.085950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.097465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 781/1565] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:05.098347 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.108573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606eec-4242-4b82-8690-5e6191bb1e79 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.112742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 785/1566] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.113687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.113894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.114477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.114787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.115030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.115654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.117770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.140897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 782/1567] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.141806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.154804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97cc1-9501-4614-bbee-33f162f89cda admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.183479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1298-bb4a-4fde-80ea-292fcbbd5114 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.188222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.188892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.189924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.189924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.190106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:05.190376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.192018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.208266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 786/1568] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:05.209377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.212873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.213498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.213780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.214056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.214704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:05.215008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.216655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.219071 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865469d7-45d8-4789-b93a-9b4b42a929b9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.223749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.224363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.224639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.224912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.225535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.227412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.228656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 783/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:05.229458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.239159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb8251-60ce-427d-bdd8-ef3766c64580 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.244376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.244971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.245276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.245528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.246157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.247901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.260773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 787/1570] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.260773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.261026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 784/1571] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.261026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.271105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce25c5-6aba-4b72-bf91-22f5d90c3771 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.300580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:05.314665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:05.326911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0c7d-c5fc-4140-a5fe-23f0c17fa6da admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.329396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.330010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.330295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.330571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.331200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.333163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.334025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.334760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.335150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.335421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.336150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.338154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.359937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 788/1572] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.360728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.368182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 785/1573] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.368182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.373440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33de0c1-accc-4865-a794-004ed9a41db6 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.429130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.429376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1774d-9225-4827-9188-ec5505052f8c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.429737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.430018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.430286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.430903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.432845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.433684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.434280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.434558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.434824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.435451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.437063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.448162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 786/1574] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.448938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.456872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 789/1575] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.458264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.458677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c13bbc-83e5-4a7d-a4f1-05566e2bb311 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.464002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.464631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.464912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.465185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.465802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.467698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.467956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4c7da-6480-4909-950d-e31c32f76912 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.473798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.474398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.474678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.474952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.475578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.477524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.496345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 787/1576] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.501212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.509512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 790/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.510493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.571618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20e84-1e69-4d49-a800-07569c5de63d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.576569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.577312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.577545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.577668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83f6a4-7ded-478c-b719-2068467c5acd admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.577850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.578446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.580425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.582891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.583508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.583785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.584065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.584828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.586416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.597771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 791/1578] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.598804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.610815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 788/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.613405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201009a9-f32b-4100-ba03-b43dc8aa25bd admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.614887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.619853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.620553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.620842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.621121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.622072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.623742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.626938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615594f4-d643-4363-9276-8543ef3a9a1f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.632162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.632823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.633100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.633370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.633991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.634575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 792/1580] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.635384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.636023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.644923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d92c-6515-43bd-86f7-f427b40bccf9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.650844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.651580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.651936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.652432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.653152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.654739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.658414 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 789/1581] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.659295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.667669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 793/1582] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.668696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.669563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc097-8e6d-4c24-b204-c9688453e814 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.676058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.676691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.676972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.677249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.677890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.679843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962a0bd-2153-427c-a146-9cdd34db3f5d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.680102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.684408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.684977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.685251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.685522 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.686161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.688036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.690737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 790/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.691505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.696513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:05.701286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113951f-1102-420c-8608-be9b87fbba43 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.706446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.707025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.707304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.707576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.708186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.710152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.710687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 794/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.711578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.720066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:05.720858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1f83a-b411-4362-83e2-dbe4febefd84 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.728173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.728847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.729123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.729398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] PATH_INFO: `/v3/projects/3e353fd32b744e08913abb7241552234/users/b5955d88bb4b435fb0540698858b45a5/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.735099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 791/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:05.735899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.744652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e353fd32b744e08913abb7241552234, user_id=b5955d88bb4b435fb0540698858b45a5, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.747301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ecf48-9f2c-4769-a3f8-d16f8e6e62ad admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.747438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.752207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.752942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.753211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.753479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.754112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.755784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.761072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 795/1586] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:05 2022] PUT /identity/v3/projects/3e353fd32b744e08913abb7241552234/users/b5955d88bb4b435fb0540698858b45a5/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:05.761870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.766382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 792/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.767087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.777354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3dba6-ffcd-4583-8118-be0bfb1a8715 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.828774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542252-9f85-4914-92d6-c2ec801421ec admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.832723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.833340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.833626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.833903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.834412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.834542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.835191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.835510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.835904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.836140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.836589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.838189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.849711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 793/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.849711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.849996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 796/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.851163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.862473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fc86f-a8ad-4118-a661-588dcc66148e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.862665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4701-f077-4db2-a9fc-c1edbd6f88df admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.867939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.868175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.868631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.868799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.868911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.869084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.869194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] PATH_INFO: `/v3/projects/2ffc5b3b8667420fa8d594f35b1b8fac/users/d6db13fea0f84e9cafd6e21a3b4f770e/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.869363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.870006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.871601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.881725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 797/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.882593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.888174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffc5b3b8667420fa8d594f35b1b8fac, user_id=d6db13fea0f84e9cafd6e21a3b4f770e, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.889428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:28:05.889428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:28:05.889428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:28:05.891390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.891839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b509d6-4fa1-4cab-abd4-c22852b1235e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.896862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542f16c-aab1-4edb-a56f-1cd0838c54f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.897617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f16c-aab1-4edb-a56f-1cd0838c54f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.898014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f16c-aab1-4edb-a56f-1cd0838c54f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.898352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f16c-aab1-4edb-a56f-1cd0838c54f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.899160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542f16c-aab1-4edb-a56f-1cd0838c54f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.900932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542f16c-aab1-4edb-a56f-1cd0838c54f1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.906400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 794/1591] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:05 2022] PUT /identity/v3/projects/2ffc5b3b8667420fa8d594f35b1b8fac/users/d6db13fea0f84e9cafd6e21a3b4f770e/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:05.907274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.912329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 798/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.914278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa43994-4bd4-4886-ae72-664300ac134d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.914574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa43994-4bd4-4886-ae72-664300ac134d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.914839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa43994-4bd4-4886-ae72-664300ac134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.933129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6aa43994-4bd4-4886-ae72-664300ac134d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:05.934335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6aa43994-4bd4-4886-ae72-664300ac134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:05.974956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e634b-8127-4995-8590-7ebf6fafb63d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:05.980231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:05.980886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:05.981172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:05.981451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:05.982092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:05.983689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:05.993744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 795/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:05.996646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 799/1594] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:05.996780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:05.996866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa43994-4bd4-4886-ae72-664300ac134d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.005701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa43994-4bd4-4886-ae72-664300ac134d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.006413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8a821-1044-4a1c-83c5-915358f82b65 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.010422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.011019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.011262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.011383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.011546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.011870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.012146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.012253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.012459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.013096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.013797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.014680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.024070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 800/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:06.024934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.028157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 796/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:06.028157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.036392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1587-1569-498a-b5d6-2630fc933016 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.037704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4c15b-5a70-4f63-ab08-95099437a2eb admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.041165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.041797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.042092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.042362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] PATH_INFO: `/v3/projects/848ad2383e184d1880138b9568cac298/users/6a19a28abdb74951a9b3e86d91c2a1c7/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.042554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2085b0-a50e-4101-a1c3-daeafe80035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.043185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2085b0-a50e-4101-a1c3-daeafe80035b admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.043464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2085b0-a50e-4101-a1c3-daeafe80035b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.043735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2085b0-a50e-4101-a1c3-daeafe80035b admin admin] PATH_INFO: `/v3/projects/79a028c9ccfb438884df5457ebfebae7/users/686afeec87d34ad8a547d81f25de2428/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.059252 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848ad2383e184d1880138b9568cac298, user_id=6a19a28abdb74951a9b3e86d91c2a1c7, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.060326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2085b0-a50e-4101-a1c3-daeafe80035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a028c9ccfb438884df5457ebfebae7, user_id=686afeec87d34ad8a547d81f25de2428, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.062031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.063133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2085b0-a50e-4101-a1c3-daeafe80035b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.076097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 797/1597] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:06 2022] PUT /identity/v3/projects/848ad2383e184d1880138b9568cac298/users/6a19a28abdb74951a9b3e86d91c2a1c7/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:06.080808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 801/1598] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:06 2022] PUT /identity/v3/projects/79a028c9ccfb438884df5457ebfebae7/users/686afeec87d34ad8a547d81f25de2428/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:06.080973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.081085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017cd1c-0854-4728-940d-04bc194bf566 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.081085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017cd1c-0854-4728-940d-04bc194bf566 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.081085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017cd1c-0854-4728-940d-04bc194bf566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.090181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:06.098376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:06.111766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a017cd1c-0854-4728-940d-04bc194bf566 None None] MFA Rules not processed for user `d6db13fea0f84e9cafd6e21a3b4f770e`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:06.113024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a017cd1c-0854-4728-940d-04bc194bf566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:06.151582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b680915-727e-48ca-b6b6-184359f669d9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.175719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 802/1599] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:06.176659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017cd1c-0854-4728-940d-04bc194bf566 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.222605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.223286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.223744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.224060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.224742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.226363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.236765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 798/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:06.237563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.245898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017cd1c-0854-4728-940d-04bc194bf566 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.250876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.251538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.251825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.252105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.252800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.254438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.264648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 803/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:06.265417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.274552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467ed6c-68ab-4355-9213-28c1b1669fc5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.279101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.279722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.280002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.280285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] PATH_INFO: `/v3/projects/ef20d5582f33455192eebef6250b89cf/users/cd1639d77613450bad857143cb70c41a/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.294730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef20d5582f33455192eebef6250b89cf, user_id=cd1639d77613450bad857143cb70c41a, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.297508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.298378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5500e6a-9821-4012-b6f6-0012b2a578a0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.302157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cd25e-adbc-433c-9d32-d041f29810f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.302846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cd25e-adbc-433c-9d32-d041f29810f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.303229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cd25e-adbc-433c-9d32-d041f29810f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.304124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cd25e-adbc-433c-9d32-d041f29810f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.310813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 804/1602] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:06 2022] PUT /identity/v3/projects/ef20d5582f33455192eebef6250b89cf/users/cd1639d77613450bad857143cb70c41a/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:06.311592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.313591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cd25e-adbc-433c-9d32-d041f29810f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.315211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cd25e-adbc-433c-9d32-d041f29810f2 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.326036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 799/1603] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:06.327440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920eef9-d2b7-4b03-842d-70aa8d247dba None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.327726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920eef9-d2b7-4b03-842d-70aa8d247dba None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.328405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920eef9-d2b7-4b03-842d-70aa8d247dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.349831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1920eef9-d2b7-4b03-842d-70aa8d247dba None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:06.351876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1920eef9-d2b7-4b03-842d-70aa8d247dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:06.386964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29eea4-119d-482b-961f-20df4d1da129 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.392893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03b7c8-de7e-43a1-9805-c85a1ddfc557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.393628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b7c8-de7e-43a1-9805-c85a1ddfc557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.393848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b7c8-de7e-43a1-9805-c85a1ddfc557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.394127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b7c8-de7e-43a1-9805-c85a1ddfc557 admin admin] PATH_INFO: `/v3/projects/f4b251489ecf4f53aa67a28445ab1b97/users/b6a423b67e4440628fe967429698a603/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.406711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:06.410759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:06.414207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03b7c8-de7e-43a1-9805-c85a1ddfc557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b251489ecf4f53aa67a28445ab1b97, user_id=b6a423b67e4440628fe967429698a603, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.418183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03b7c8-de7e-43a1-9805-c85a1ddfc557 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.424850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 800/1604] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:06.426280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88371-db21-4f31-aa01-ddb111cd29dd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.426614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88371-db21-4f31-aa01-ddb111cd29dd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.426933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88371-db21-4f31-aa01-ddb111cd29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.435123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 805/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:06 2022] PUT /identity/v3/projects/f4b251489ecf4f53aa67a28445ab1b97/users/b6a423b67e4440628fe967429698a603/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:06.436607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc3bc7-b9e0-4925-bd01-03fcfa2ba2df None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.436896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc3bc7-b9e0-4925-bd01-03fcfa2ba2df None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.437180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc3bc7-b9e0-4925-bd01-03fcfa2ba2df None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.438429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 806/1606] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 05:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:28:06.439113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc3bc7-b9e0-4925-bd01-03fcfa2ba2df None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.466327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c8a88371-db21-4f31-aa01-ddb111cd29dd None None] MFA Rules not processed for user `6a19a28abdb74951a9b3e86d91c2a1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:06.468633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c8a88371-db21-4f31-aa01-ddb111cd29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:06.514822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc3bc7-b9e0-4925-bd01-03fcfa2ba2df None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.519411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0132fd-04d7-46c6-81d9-896a54634b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.520077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0132fd-04d7-46c6-81d9-896a54634b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.520458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0132fd-04d7-46c6-81d9-896a54634b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.520860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0132fd-04d7-46c6-81d9-896a54634b89 admin admin] PATH_INFO: `/v3/projects/ca8b8c8e8ffc4111b7bbeda7df43e1b4/users/f2951af9ee7c4c69847685e55d1b12b6/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.542074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0132fd-04d7-46c6-81d9-896a54634b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8b8c8e8ffc4111b7bbeda7df43e1b4, user_id=f2951af9ee7c4c69847685e55d1b12b6, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.544648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0132fd-04d7-46c6-81d9-896a54634b89 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.559250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 801/1607] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:06.559250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88371-db21-4f31-aa01-ddb111cd29dd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.565655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 807/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:06 2022] PUT /identity/v3/projects/ca8b8c8e8ffc4111b7bbeda7df43e1b4/users/f2951af9ee7c4c69847685e55d1b12b6/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:06.565655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910def35-76f2-4b07-b560-a012e3c7582c None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.565655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910def35-76f2-4b07-b560-a012e3c7582c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.565655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910def35-76f2-4b07-b560-a012e3c7582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.569414 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88371-db21-4f31-aa01-ddb111cd29dd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.594015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-910def35-76f2-4b07-b560-a012e3c7582c None None] MFA Rules not processed for user `cd1639d77613450bad857143cb70c41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:06.594822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-910def35-76f2-4b07-b560-a012e3c7582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:06.638232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3f43-06fc-449b-a6a9-ecf22e0f06b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.639398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3f43-06fc-449b-a6a9-ecf22e0f06b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.639692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3f43-06fc-449b-a6a9-ecf22e0f06b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.640006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3f43-06fc-449b-a6a9-ecf22e0f06b5 admin admin] PATH_INFO: `/v3/projects/ffb2cf543bc64d0a8e2632355fd8033a/users/ed192d83dde64638a74d935ff7be5c33/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.659419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc3f43-06fc-449b-a6a9-ecf22e0f06b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb2cf543bc64d0a8e2632355fd8033a, user_id=ed192d83dde64638a74d935ff7be5c33, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.662223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc3f43-06fc-449b-a6a9-ecf22e0f06b5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.668964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 808/1609] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:06.669929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910def35-76f2-4b07-b560-a012e3c7582c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.679925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 802/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:06 2022] PUT /identity/v3/projects/ffb2cf543bc64d0a8e2632355fd8033a/users/ed192d83dde64638a74d935ff7be5c33/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:06.681214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad698c-428b-4200-83ff-81aee70ccef2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.681558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad698c-428b-4200-83ff-81aee70ccef2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.681836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad698c-428b-4200-83ff-81aee70ccef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.703221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a3ad698c-428b-4200-83ff-81aee70ccef2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:06.704760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a3ad698c-428b-4200-83ff-81aee70ccef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:06.751279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910def35-76f2-4b07-b560-a012e3c7582c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.764822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:06.787951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 803/1611] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:06.789640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd71c-624d-4353-a4d2-a15c5c0a7983 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.790497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd71c-624d-4353-a4d2-a15c5c0a7983 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.790900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd71c-624d-4353-a4d2-a15c5c0a7983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.813209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.814429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.814866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.815308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.821352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:06.833541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.835789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.848960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 809/1612] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:06.849788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.856036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-42efd71c-624d-4353-a4d2-a15c5c0a7983 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:06.857412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-42efd71c-624d-4353-a4d2-a15c5c0a7983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:06.863440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601dbef-60cd-4383-8fae-d1d1dfb2701e service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:06.870647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce22922-006c-4d24-9a50-ddef06c810e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:06.871268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce22922-006c-4d24-9a50-ddef06c810e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.871553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce22922-006c-4d24-9a50-ddef06c810e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.871826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce22922-006c-4d24-9a50-ddef06c810e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.872496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce22922-006c-4d24-9a50-ddef06c810e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:06.875185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce22922-006c-4d24-9a50-ddef06c810e9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:06.912046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 810/1613] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:06.914367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6762-590f-4a81-b253-99b1465bfd9e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:06.914654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6762-590f-4a81-b253-99b1465bfd9e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:06.914927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6762-590f-4a81-b253-99b1465bfd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:06.934865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-eecf6762-590f-4a81-b253-99b1465bfd9e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:06.936063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eecf6762-590f-4a81-b253-99b1465bfd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:06.939803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 804/1614] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:06.942703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd71c-624d-4353-a4d2-a15c5c0a7983 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:06.956662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd71c-624d-4353-a4d2-a15c5c0a7983 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.009690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 811/1615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:07.011205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d80bd-6c26-4f44-aa83-c65e0a2df975 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.011588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d80bd-6c26-4f44-aa83-c65e0a2df975 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.012302 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d80bd-6c26-4f44-aa83-c65e0a2df975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.033538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.034285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.034632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.034972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.035604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.037578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.053457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-713d80bd-6c26-4f44-aa83-c65e0a2df975 None None] MFA Rules not processed for user `ed192d83dde64638a74d935ff7be5c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:07.055813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-713d80bd-6c26-4f44-aa83-c65e0a2df975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:07.068896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 805/1616] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:06 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:07.070554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.139971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 812/1617] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:07.139971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d80bd-6c26-4f44-aa83-c65e0a2df975 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.144894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff684c-61de-4684-b5ec-39632d48caa9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.149681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d80bd-6c26-4f44-aa83-c65e0a2df975 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.150062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.150831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.151248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.151630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.179818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:07.188153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:07.221081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.221855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.222202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.222548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.223557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.226349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.228109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.229786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.242365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 806/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:07.243365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.258008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 813/1619] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:07 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:07.259069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.279876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb74c1-d929-4df0-ab69-e82e5d78fda3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.300966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.301610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.301891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.302168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.326750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.329895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.358762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 814/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:07.359822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.371969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26a1a6-d785-4401-b1db-667a6a4803f5 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.379513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.380438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.380724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.381051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.383350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52150d-b7a7-40d7-860a-8f21ce332f89 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.402266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.402874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.403420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.403420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.404253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.406092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.446285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 815/1621] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:07 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:07.447219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.456996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.459081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.466647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719a75-a8bf-4ef6-96b6-fb3d285d436c admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.473166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 807/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:07.480170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.480841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.481125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.481424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.482068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.483973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.485428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.512519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253883-39a3-4f69-a362-0608b5e0e383 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.522024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.524649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.524944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.525224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.526241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.528843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.538663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 816/1623] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:07 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:07.539337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.554019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 808/1624] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:07.557493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.582053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea054f-24a5-42ce-88a7-89a143c28ce2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.669885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592233ec-0612-4683-96b2-d2cf1ac39901 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.681759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.682393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.682675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.682949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.683603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.685248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.688434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:07.705624 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 817/1625] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:07.706068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.706504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.706876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.707253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.707624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.708530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.716473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.725752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57711380-02cf-453d-848a-a9addfa35c67 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.741533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.742226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.742475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.742752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] PATH_INFO: `/v3/projects/5a5f1d362aef4df0a4a6405c305cb8be/users/2593f8995cba456796df3f88705ae702/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.759534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 809/1626] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:07 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:07.760491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.776589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5f1d362aef4df0a4a6405c305cb8be, user_id=2593f8995cba456796df3f88705ae702, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.779573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.782984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476eca8-bdea-4812-9707-6e2d518b4425 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.794235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:07.797680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:07.799628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:07.799628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] PATH_INFO: `/v3/projects/af34ee2a003d499d8b359cdba42d0af7/users/03307baac7b448e386b9ed8aaf4c9b97/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:07.800917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 818/1627] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:07 2022] PUT /identity/v3/projects/5a5f1d362aef4df0a4a6405c305cb8be/users/2593f8995cba456796df3f88705ae702/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:07.801750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.832917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af34ee2a003d499d8b359cdba42d0af7, user_id=03307baac7b448e386b9ed8aaf4c9b97, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:07.840703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:07.863613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 810/1628] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:07 2022] PUT /identity/v3/projects/af34ee2a003d499d8b359cdba42d0af7/users/03307baac7b448e386b9ed8aaf4c9b97/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:07.864500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:07.904867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:07.938940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19e6dc-e1fd-4283-a5c0-9068ac65ab75 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:07.991752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a2e1d-f6bd-4304-a513-43fac4c9c73b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.005785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.006427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.007242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.007541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.008233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.009929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:08.047061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 811/1629] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:08.047938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:08.064857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5c9b6-8621-4595-9087-ddb61adec388 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.068348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a6224-7fb6-4d79-9e76-a00f943de6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.069004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a6224-7fb6-4d79-9e76-a00f943de6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.069830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a6224-7fb6-4d79-9e76-a00f943de6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.070134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a6224-7fb6-4d79-9e76-a00f943de6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.070790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a6224-7fb6-4d79-9e76-a00f943de6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.072449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a6224-7fb6-4d79-9e76-a00f943de6e1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:08.083935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.084477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 819/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:08.088310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.088988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.089538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ed712-25aa-4b80-b376-bb342d9b7bb8 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.089757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.089886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ed712-25aa-4b80-b376-bb342d9b7bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.090164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ed712-25aa-4b80-b376-bb342d9b7bb8 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.090970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.091840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 820/1631] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 21 05:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:28:08.092612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ed712-25aa-4b80-b376-bb342d9b7bb8 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:08.097425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:08.107323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ed712-25aa-4b80-b376-bb342d9b7bb8 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.112988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db77335-d039-4246-8a44-28db374eff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.113699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db77335-d039-4246-8a44-28db374eff7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.114099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db77335-d039-4246-8a44-28db374eff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.114462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db77335-d039-4246-8a44-28db374eff7f admin admin] PATH_INFO: `/v3/projects/5a5f1d362aef4df0a4a6405c305cb8be/users/2593f8995cba456796df3f88705ae702/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.118042 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db77335-d039-4246-8a44-28db374eff7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5f1d362aef4df0a4a6405c305cb8be, user_id=2593f8995cba456796df3f88705ae702, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.120481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db77335-d039-4246-8a44-28db374eff7f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:08.139328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 812/1632] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:08.141387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:08.172755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 821/1633] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:08 2022] PUT /identity/v3/projects/5a5f1d362aef4df0a4a6405c305cb8be/users/2593f8995cba456796df3f88705ae702/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:08.177080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85e6d-ca30-495b-a1e5-922a90891c60 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.177793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85e6d-ca30-495b-a1e5-922a90891c60 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.178283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85e6d-ca30-495b-a1e5-922a90891c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.181994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb5f59-1759-47a0-b505-732076a04997 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.209849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-9df85e6d-ca30-495b-a1e5-922a90891c60 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:08.211572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9df85e6d-ca30-495b-a1e5-922a90891c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:08.282949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.283876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.284416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.284882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] PATH_INFO: `/v3/projects/3b736a4ef32b4d40a19009d3c10e5ccc/users/a3a7dcd0e4b342249dc317fc1d33ba7f/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.304957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b736a4ef32b4d40a19009d3c10e5ccc, user_id=a3a7dcd0e4b342249dc317fc1d33ba7f, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.307866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:08.326253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 813/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:08 2022] PUT /identity/v3/projects/3b736a4ef32b4d40a19009d3c10e5ccc/users/a3a7dcd0e4b342249dc317fc1d33ba7f/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:08.329937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:08.335569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 822/1635] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:28:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:08.338672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b715-5fcf-48b2-a5a0-1cd3f66625cb None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.339382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b715-5fcf-48b2-a5a0-1cd3f66625cb None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.339889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b715-5fcf-48b2-a5a0-1cd3f66625cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.401161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-2683b715-5fcf-48b2-a5a0-1cd3f66625cb None None] MFA Rules not processed for user `2593f8995cba456796df3f88705ae702`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:08.402279 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:08.403796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2683b715-5fcf-48b2-a5a0-1cd3f66625cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:08.470533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2bb8-bb69-4eb5-ae50-8ddc76cb7d7d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.480727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.482018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.483044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.483992 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] PATH_INFO: `/v3/projects/af34ee2a003d499d8b359cdba42d0af7/users/03307baac7b448e386b9ed8aaf4c9b97/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.488006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af34ee2a003d499d8b359cdba42d0af7, user_id=03307baac7b448e386b9ed8aaf4c9b97, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.493130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:08.511070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:08.527571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 814/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:08 2022] PUT /identity/v3/projects/af34ee2a003d499d8b359cdba42d0af7/users/03307baac7b448e386b9ed8aaf4c9b97/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:08.529159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:08.591483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 823/1637] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:08.593154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b715-5fcf-48b2-a5a0-1cd3f66625cb None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:08.657599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447800-830d-446e-9021-b5333f35e18a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.671085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583200c-c949-43c1-bbd1-efbc5b45a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.672589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583200c-c949-43c1-bbd1-efbc5b45a011 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.672881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583200c-c949-43c1-bbd1-efbc5b45a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.673164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583200c-c949-43c1-bbd1-efbc5b45a011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.676679 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583200c-c949-43c1-bbd1-efbc5b45a011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.680614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583200c-c949-43c1-bbd1-efbc5b45a011 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:08.699295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 815/1638] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:08.701905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb6936-c7a4-4df4-8ed3-04ae9c73ca04 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.702536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb6936-c7a4-4df4-8ed3-04ae9c73ca04 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.702823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb6936-c7a4-4df4-8ed3-04ae9c73ca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.703455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b715-5fcf-48b2-a5a0-1cd3f66625cb None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.750054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b0bb6936-c7a4-4df4-8ed3-04ae9c73ca04 None None] MFA Rules not processed for user `03307baac7b448e386b9ed8aaf4c9b97`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:08.752569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b0bb6936-c7a4-4df4-8ed3-04ae9c73ca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:08.805671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.807271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.808116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.808637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.872242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 816/1639] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:08.874041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb6936-c7a4-4df4-8ed3-04ae9c73ca04 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:08.891020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb6936-c7a4-4df4-8ed3-04ae9c73ca04 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:08.897350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6f90-6d8b-4b27-8310-2a73a3687970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:08.898140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6f90-6d8b-4b27-8310-2a73a3687970 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:08.899605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6f90-6d8b-4b27-8310-2a73a3687970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:08.899904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6f90-6d8b-4b27-8310-2a73a3687970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:08.968299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:08.968753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:08.970554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:09.000319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 824/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:09.001301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:09.004828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d6f90-6d8b-4b27-8310-2a73a3687970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:09.006790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d6f90-6d8b-4b27-8310-2a73a3687970 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:09.022032 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 817/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:09.024166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a3254-e653-42a0-adc3-86d4b53be6bf service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:09.033460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:09.034296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:09.034678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:09.035084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] PATH_INFO: `/v3/projects/3b736a4ef32b4d40a19009d3c10e5ccc/users/a3a7dcd0e4b342249dc317fc1d33ba7f/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:09.049340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b736a4ef32b4d40a19009d3c10e5ccc, user_id=a3a7dcd0e4b342249dc317fc1d33ba7f, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:09.052424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:09.074827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 825/1642] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:09 2022] PUT /identity/v3/projects/3b736a4ef32b4d40a19009d3c10e5ccc/users/a3a7dcd0e4b342249dc317fc1d33ba7f/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:09.089737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf7332-93ee-45ee-81f6-3f0a8405b37b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:09.090320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf7332-93ee-45ee-81f6-3f0a8405b37b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:09.091060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf7332-93ee-45ee-81f6-3f0a8405b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:09.167234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:09.193299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-57bf7332-93ee-45ee-81f6-3f0a8405b37b None None] MFA Rules not processed for user `a3a7dcd0e4b342249dc317fc1d33ba7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:09.194922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-57bf7332-93ee-45ee-81f6-3f0a8405b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:09.229222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:09.289529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6169-de28-4247-8033-cee4da99423e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:09.302005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:09.302779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:09.303187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:09.303612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:09.337222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 818/1643] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:09.453615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:09.455347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:09.477236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 826/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:09.591087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf7332-93ee-45ee-81f6-3f0a8405b37b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:09.607045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf7332-93ee-45ee-81f6-3f0a8405b37b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:09.611487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:09.612269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:09.613268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:09.613772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:09.624913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:09.627228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:09.656853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 819/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:09.916110 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:09.928139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4458f8-57d9-472f-8fd3-d73523683835 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:09.933783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add63c9e-1892-4c56-b9be-e56273603ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:09.936761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add63c9e-1892-4c56-b9be-e56273603ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:09.938174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add63c9e-1892-4c56-b9be-e56273603ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:09.938460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add63c9e-1892-4c56-b9be-e56273603ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:10.108267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add63c9e-1892-4c56-b9be-e56273603ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:10.109957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add63c9e-1892-4c56-b9be-e56273603ea1 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:10.145634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 827/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:10.152035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:10.164787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e6e3b-73a2-46c4-8550-2c77b39c7800 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:10.175240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d5418-9fea-46ec-bf27-ce38d5131d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:10.175954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d5418-9fea-46ec-bf27-ce38d5131d2d service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:10.176242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d5418-9fea-46ec-bf27-ce38d5131d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:10.176545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d5418-9fea-46ec-bf27-ce38d5131d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:10.329151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d5418-9fea-46ec-bf27-ce38d5131d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:10.339189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d5418-9fea-46ec-bf27-ce38d5131d2d service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:10.384092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 820/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:10.828811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a743-0b60-4b74-a906-6afe8cb6df66 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:10.829374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a743-0b60-4b74-a906-6afe8cb6df66 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:10.829374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a743-0b60-4b74-a906-6afe8cb6df66 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:10.831598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 828/1648] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 21 05:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:28:10.858911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cee6f-b0b4-4b68-84ba-20a73fa42e2c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:10.866752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cee6f-b0b4-4b68-84ba-20a73fa42e2c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:10.867148 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cee6f-b0b4-4b68-84ba-20a73fa42e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:10.924524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-077cee6f-b0b4-4b68-84ba-20a73fa42e2c None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:10.928065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-077cee6f-b0b4-4b68-84ba-20a73fa42e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:11.050283 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:11.160389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2355d2-c966-4fbc-993a-a4ef1cdd5e5e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:11.160389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2355d2-c966-4fbc-993a-a4ef1cdd5e5e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:11.160389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2355d2-c966-4fbc-993a-a4ef1cdd5e5e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:11.160389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 829/1649] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 21 05:28:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:28:11.164422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 821/1650] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 21 05:28:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:11.167326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27009704-b144-4c5a-b367-506b266d6d49 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:11.167772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27009704-b144-4c5a-b367-506b266d6d49 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:11.168183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27009704-b144-4c5a-b367-506b266d6d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:11.206409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-27009704-b144-4c5a-b367-506b266d6d49 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:11.208528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-27009704-b144-4c5a-b367-506b266d6d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:11.210315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cee6f-b0b4-4b68-84ba-20a73fa42e2c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:11.258913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 830/1651] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:28:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:11.260263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27009704-b144-4c5a-b367-506b266d6d49 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:11.275539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27009704-b144-4c5a-b367-506b266d6d49 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:11.279710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f859ce0-57b4-4d34-be41-2a2793e9431a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:11.280679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f859ce0-57b4-4d34-be41-2a2793e9431a service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:11.281091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f859ce0-57b4-4d34-be41-2a2793e9431a service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:11.281523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f859ce0-57b4-4d34-be41-2a2793e9431a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:11.297757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f859ce0-57b4-4d34-be41-2a2793e9431a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:11.299282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cee6f-b0b4-4b68-84ba-20a73fa42e2c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:11.299401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f859ce0-57b4-4d34-be41-2a2793e9431a service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:11.313304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 831/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:11.315000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:11.316096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:11.316096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:11.316472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] PATH_INFO: `/v3/users/6a19a28abdb74951a9b3e86d91c2a1c7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:11.317696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a19a28abdb74951a9b3e86d91c2a1c7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:11.318693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: WARNING py.warnings [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:28:11.318693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: warnings.warn(msg) Sep 21 05:28:11.318693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: Sep 21 05:28:11.320038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:11.469727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a19a28abdb74951a9b3e86d91c2a1c7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:11.483056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a19a28abdb74951a9b3e86d91c2a1c7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:11.485436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a19a28abdb74951a9b3e86d91c2a1c7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:11.532966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a19a28abdb74951a9b3e86d91c2a1c7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:11.551487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a19a28abdb74951a9b3e86d91c2a1c7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:11.564919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 822/1653] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:11 2022] DELETE /identity/v3/users/6a19a28abdb74951a9b3e86d91c2a1c7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:11.566206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:11.566517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:11.566781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:11.594429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:11.595822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:11.780430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:11.806475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 832/1654] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:11.875254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:11.876991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:12.042286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0898-fdba-414e-b4b1-ead02a66c102 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:12.056868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:12.057507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:12.057794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:12.058068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:12.075903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:12.080163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:12.090843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:12.109205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 823/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:13.665434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:13.668154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:13.691494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79690-06ad-421c-8977-b4a9f85d1502 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:13.706015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:13.706964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:13.707396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:13.707818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] PATH_INFO: `/v3/projects/848ad2383e184d1880138b9568cac298` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:13.714727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=848ad2383e184d1880138b9568cac298)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:13.716067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: WARNING py.warnings [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 05:28:13.716067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: warnings.warn(msg) Sep 21 05:28:13.716067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: Sep 21 05:28:13.717635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:13.868260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848ad2383e184d1880138b9568cac298', 'request_id': 'req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:13.884775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848ad2383e184d1880138b9568cac298', 'request_id': 'req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:13.913504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848ad2383e184d1880138b9568cac298', 'request_id': 'req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:13.989952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] The token cache is being invalidate because project 848ad2383e184d1880138b9568cac298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:13.991047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:13.992766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:13.997202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 833/1656] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:13 2022] DELETE /identity/v3/projects/848ad2383e184d1880138b9568cac298 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:14.001356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:14.013363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ec20-26c0-44dd-a3ef-6a85e2ad8176 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:14.198070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:14.204667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:14.205262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:14.205566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] PATH_INFO: `/v3/users/2593f8995cba456796df3f88705ae702` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:14.206915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2593f8995cba456796df3f88705ae702)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:14.209295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:14.353953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2593f8995cba456796df3f88705ae702'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:14.375060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2593f8995cba456796df3f88705ae702'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:14.375746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2593f8995cba456796df3f88705ae702'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:14.415557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2593f8995cba456796df3f88705ae702'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:14.436402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-884079bb-c998-4f76-8519-175869a237ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2593f8995cba456796df3f88705ae702'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:14.458103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 824/1657] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:14 2022] DELETE /identity/v3/users/2593f8995cba456796df3f88705ae702 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:14.732063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:14.734567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:14.766009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c6b4-5e6e-47e7-aa4c-75d1e74d6f36 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:14.944679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:14.945568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:14.946069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:14.946556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] PATH_INFO: `/v3/users/cd1639d77613450bad857143cb70c41a` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:14.949346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1639d77613450bad857143cb70c41a)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:14.953674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:15.085607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1639d77613450bad857143cb70c41a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.102306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1639d77613450bad857143cb70c41a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.103126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1639d77613450bad857143cb70c41a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.116909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1639d77613450bad857143cb70c41a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.147714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1639d77613450bad857143cb70c41a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.157083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:15.163792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 834/1658] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:14 2022] DELETE /identity/v3/users/cd1639d77613450bad857143cb70c41a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:15.168318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:15.168876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:15.168876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:15.221642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:15.223002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:15.390253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 825/1659] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:15.496119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:15.496904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:15.505794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:15.507940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:15.530468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d999b-4841-457e-ac26-6bd78ba62741 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:15.558042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:15.558704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:15.558981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:15.559254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] PATH_INFO: `/v3/users/d6db13fea0f84e9cafd6e21a3b4f770e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:15.561587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6db13fea0f84e9cafd6e21a3b4f770e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:15.563704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:15.617404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:15.676125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e77e48-8208-456a-828c-4c4954af35e5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:15.701321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8688659-777c-4e0d-a7ca-b450e71fb5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:15.702314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688659-777c-4e0d-a7ca-b450e71fb5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:15.702942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688659-777c-4e0d-a7ca-b450e71fb5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:15.703363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688659-777c-4e0d-a7ca-b450e71fb5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:15.723809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8688659-777c-4e0d-a7ca-b450e71fb5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:15.725455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8688659-777c-4e0d-a7ca-b450e71fb5c3 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:15.732619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6db13fea0f84e9cafd6e21a3b4f770e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.742545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 835/1660] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:15.759050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6db13fea0f84e9cafd6e21a3b4f770e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.764360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6db13fea0f84e9cafd6e21a3b4f770e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.788908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6db13fea0f84e9cafd6e21a3b4f770e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.804487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6db13fea0f84e9cafd6e21a3b4f770e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:15.821155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 826/1661] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:15 2022] DELETE /identity/v3/users/d6db13fea0f84e9cafd6e21a3b4f770e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:28:15.825747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:15.826048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:15.826402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:15.873807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:15.896620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:16.070419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 836/1662] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:16.535472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:16.537663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:16.672839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705ee83-e97f-4347-82f0-3930657711da admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:16.696045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8119e-0d9f-41c0-84cf-28f53eb5525e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:16.697563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8119e-0d9f-41c0-84cf-28f53eb5525e service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:16.698338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8119e-0d9f-41c0-84cf-28f53eb5525e service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:16.698796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8119e-0d9f-41c0-84cf-28f53eb5525e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:16.732932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8119e-0d9f-41c0-84cf-28f53eb5525e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:16.734426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8119e-0d9f-41c0-84cf-28f53eb5525e service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:16.762752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 827/1663] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:17.035829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:17.037327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:17.071731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a91678-3402-43f6-8a46-a21e3b450cb4 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:17.089003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:17.089671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:17.089958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:17.090237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] PATH_INFO: `/v3/projects/5a5f1d362aef4df0a4a6405c305cb8be` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:17.100309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5f1d362aef4df0a4a6405c305cb8be)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:17.102533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:17.215584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5f1d362aef4df0a4a6405c305cb8be', 'request_id': 'req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.227222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5f1d362aef4df0a4a6405c305cb8be', 'request_id': 'req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.243426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5f1d362aef4df0a4a6405c305cb8be', 'request_id': 'req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.264561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] The token cache is being invalidate because project 5a5f1d362aef4df0a4a6405c305cb8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:17.264999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.265832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a7d1f256-69a1-4fcf-a0e2-7b35d4817dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.269586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 837/1664] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:17 2022] DELETE /identity/v3/projects/5a5f1d362aef4df0a4a6405c305cb8be => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:17.280309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:17.281294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:17.281593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:17.332744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:17.359077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:17.587823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 828/1665] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:17.590099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14f39-45e5-4075-9b57-f9db0ebb986e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:17.590572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14f39-45e5-4075-9b57-f9db0ebb986e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:17.591019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14f39-45e5-4075-9b57-f9db0ebb986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:17.628985 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:17.630466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:17.633386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1cc14f39-45e5-4075-9b57-f9db0ebb986e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:17.634867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1cc14f39-45e5-4075-9b57-f9db0ebb986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:17.648942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8a1f4-7051-48da-8b86-6099adcacbf1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:17.657339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 838/1666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:17.662095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14f39-45e5-4075-9b57-f9db0ebb986e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:17.669114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:17.669781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:17.670069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:17.670340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] PATH_INFO: `/v3/projects/ef20d5582f33455192eebef6250b89cf` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:17.671596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef20d5582f33455192eebef6250b89cf)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:17.673551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:17.686925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14f39-45e5-4075-9b57-f9db0ebb986e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:17.702704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:17.703433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:17.703794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:17.704133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:17.704894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:17.705279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:17.706978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:17.759716 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 839/1667] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:28:17.760904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:17.762006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:17.789002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6028a-82e3-4c26-a914-744b6368fa19 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:17.798834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:17.799183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef20d5582f33455192eebef6250b89cf', 'request_id': 'req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.818490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef20d5582f33455192eebef6250b89cf', 'request_id': 'req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.844852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef20d5582f33455192eebef6250b89cf', 'request_id': 'req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.872753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] The token cache is being invalidate because project ef20d5582f33455192eebef6250b89cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:17.873489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.874497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:17.876627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 829/1668] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:17 2022] DELETE /identity/v3/projects/ef20d5582f33455192eebef6250b89cf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:17.882645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:17.885360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:17.940544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:17.941605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:17.942032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:17.942585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:17.943433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:17.947092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:18.040638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 840/1669] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:17 2022] POST /identity/v3/projects => generated 363 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:18.044542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:18.053232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:18.090780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d289d2-bf53-4be8-97a6-fa77fdd01c50 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:18.261142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82525-8ba2-453a-bd6a-ae51e7af91cf admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:18.282586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:18.283224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:18.283327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:18.283538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:18.283772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:18.283968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:18.284186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:18.284447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:18.284540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] PATH_INFO: `/v3/users/03307baac7b448e386b9ed8aaf4c9b97` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:18.286396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:18.289085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03307baac7b448e386b9ed8aaf4c9b97)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:18.291113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:18.335366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 841/1670] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:18 2022] POST /identity/v3/users => generated 282 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:28:18.339696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:18.364582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85051d46-82ec-4acd-9ba2-f12d5cd13206 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:18.371355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:18.371993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:18.372297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:18.372578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:18.373234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:18.375112 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:18.400396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03307baac7b448e386b9ed8aaf4c9b97'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:18.405783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 842/1671] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:28:18.410180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:18.418052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03307baac7b448e386b9ed8aaf4c9b97'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:18.418693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03307baac7b448e386b9ed8aaf4c9b97'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:18.429074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24e095-c5d4-4c1f-8ac1-256a8d0a3f96 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:18.437263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:18.443882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03307baac7b448e386b9ed8aaf4c9b97'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:18.449850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fbd10-5ff6-4597-bed0-95034b0df321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:18.450480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fbd10-5ff6-4597-bed0-95034b0df321 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:18.450763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fbd10-5ff6-4597-bed0-95034b0df321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:18.451037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fbd10-5ff6-4597-bed0-95034b0df321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:18.451690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fbd10-5ff6-4597-bed0-95034b0df321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:18.453777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fbd10-5ff6-4597-bed0-95034b0df321 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:18.458114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03307baac7b448e386b9ed8aaf4c9b97'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:18.469521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 830/1672] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:17 2022] DELETE /identity/v3/users/03307baac7b448e386b9ed8aaf4c9b97 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:18.484903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 843/1673] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:28:18.488710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:18.490146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:18.658802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632e9bf-c875-4952-a000-755a2ecd33d5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:18.674864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:18.675562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:18.675844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:18.676123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] PATH_INFO: `/v3/projects/42422242ffb94f2a9a56e5a2d733ade3/users/d8046b26c22e4492aac5e427a52f2dd3/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:18.718941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42422242ffb94f2a9a56e5a2d733ade3, user_id=d8046b26c22e4492aac5e427a52f2dd3, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:18.721681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:18.747249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 831/1674] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:18 2022] PUT /identity/v3/projects/42422242ffb94f2a9a56e5a2d733ade3/users/d8046b26c22e4492aac5e427a52f2dd3/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:18.762488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d7d9-f100-43c7-8e9c-a25c296094f0 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:18.762819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d7d9-f100-43c7-8e9c-a25c296094f0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:18.763047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d7d9-f100-43c7-8e9c-a25c296094f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:18.822891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e660d7d9-f100-43c7-8e9c-a25c296094f0 None None] MFA Rules not processed for user `d8046b26c22e4492aac5e427a52f2dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:18.824658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e660d7d9-f100-43c7-8e9c-a25c296094f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:18.903998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:18.941228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 844/1675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:18.945611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:19.138186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaff1e-0599-4ef1-95a2-572c17cc7109 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:19.158975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:19.159308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.159592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.159878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.160669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:19.163776 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:19.244898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 832/1676] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:18 2022] POST /identity/v3/projects => generated 363 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:19.249381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660d7d9-f100-43c7-8e9c-a25c296094f0 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:19.277428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660d7d9-f100-43c7-8e9c-a25c296094f0 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:19.500868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:19.501550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.501850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.502130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.502782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:19.513854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:19.562188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 845/1677] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:19 2022] POST /identity/v3/users => generated 288 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:19.566014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:19.580339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2024aa-24d2-435b-b987-56eeaf85421f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:19.594269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:19.594900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.595183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.595458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.596579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:19.598596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:19.604546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:19.606884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:19.634222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9801-8b1c-4ffe-8dbd-6b6cff399712 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:19.651130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 833/1678] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:19.652231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:19.655991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:19.656883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.658261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.660306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] PATH_INFO: `/v3/projects/2ffc5b3b8667420fa8d594f35b1b8fac` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.664694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffc5b3b8667420fa8d594f35b1b8fac)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:19.673676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:19.689484 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c261a-2ffd-4d7c-b412-62e5eb7a64ad admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:19.701921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:19.703879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.704966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.705809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] PATH_INFO: `/v3/projects/59bc3ffd3d274286b39253a9148406da/users/f15f4de707974744ae6ea33e5a8f785b/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.746293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bc3ffd3d274286b39253a9148406da, user_id=f15f4de707974744ae6ea33e5a8f785b, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:19.750588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:19.787992 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 834/1679] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:19 2022] PUT /identity/v3/projects/59bc3ffd3d274286b39253a9148406da/users/f15f4de707974744ae6ea33e5a8f785b/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:19.791598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:19.800565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffc5b3b8667420fa8d594f35b1b8fac', 'request_id': 'req-f631afda-65c7-4838-9ae6-ed8ddc032939'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:19.817453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffc5b3b8667420fa8d594f35b1b8fac', 'request_id': 'req-f631afda-65c7-4838-9ae6-ed8ddc032939'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:19.833783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffc5b3b8667420fa8d594f35b1b8fac', 'request_id': 'req-f631afda-65c7-4838-9ae6-ed8ddc032939'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:19.850641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:19.877258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] The token cache is being invalidate because project 2ffc5b3b8667420fa8d594f35b1b8fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:19.877676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:19.878763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f631afda-65c7-4838-9ae6-ed8ddc032939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:19.887722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 846/1680] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:19 2022] DELETE /identity/v3/projects/2ffc5b3b8667420fa8d594f35b1b8fac => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:28:19.889884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83e1d1-a211-4815-bae0-c117c14525c0 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.890324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83e1d1-a211-4815-bae0-c117c14525c0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.891993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83e1d1-a211-4815-bae0-c117c14525c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.937206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0a83e1d1-a211-4815-bae0-c117c14525c0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:19.940400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0a83e1d1-a211-4815-bae0-c117c14525c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:19.955480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e1ede-3dc3-4f07-a954-5ef18b31a69b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:19.961587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 847/1681] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:19.972396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aab18-e3f2-4d50-b228-8499ebc1f295 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.980113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aab18-e3f2-4d50-b228-8499ebc1f295 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.980113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aab18-e3f2-4d50-b228-8499ebc1f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.984975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:19.985731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:19.985940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:19.986163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:19.995483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:20.000939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:20.026306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e20aab18-e3f2-4d50-b228-8499ebc1f295 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:20.026917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 835/1682] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:20.028863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e20aab18-e3f2-4d50-b228-8499ebc1f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:20.030381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:20.034310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:20.062959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 848/1683] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:20.064675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aab18-e3f2-4d50-b228-8499ebc1f295 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:20.075005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5404-bd9c-4193-b618-5dca478edd6a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:20.084971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7002fe-bfc6-434a-af9b-fe920ac73513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:20.085494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aab18-e3f2-4d50-b228-8499ebc1f295 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:20.088777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7002fe-bfc6-434a-af9b-fe920ac73513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:20.089350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7002fe-bfc6-434a-af9b-fe920ac73513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:20.090818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7002fe-bfc6-434a-af9b-fe920ac73513 admin admin] PATH_INFO: `/v3/projects/59bc3ffd3d274286b39253a9148406da/users/f15f4de707974744ae6ea33e5a8f785b/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:20.095440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7002fe-bfc6-434a-af9b-fe920ac73513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bc3ffd3d274286b39253a9148406da, user_id=f15f4de707974744ae6ea33e5a8f785b, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:20.097336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:20.098468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:20.098828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:20.099181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:20.100826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:20.101357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:20.106131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:20.108018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7002fe-bfc6-434a-af9b-fe920ac73513 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:20.144165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 836/1684] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:20 2022] PUT /identity/v3/projects/59bc3ffd3d274286b39253a9148406da/users/f15f4de707974744ae6ea33e5a8f785b/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:20.160738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:20.161291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:20.161814 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:20.177660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 849/1685] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:20.186113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:20.236487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04df0f-1271-489b-82a4-c14bc7e67662 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:20.267371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] MFA Rules not processed for user `f15f4de707974744ae6ea33e5a8f785b`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:20.269001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:20.440908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:20.498262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 837/1686] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:20.499292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:20.509232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:20.546946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:20.547597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:20.547882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:20.548163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:20.548880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:20.565953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:20.701159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 850/1687] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:20 2022] POST /identity/v3/projects => generated 369 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:20.702123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:20.715044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:20.746432 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d345-0f9c-4172-857b-2c60c0463c48 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:20.830982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:20.894294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:20.895357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:20.895834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:20.896478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] PATH_INFO: `/v3/projects/af34ee2a003d499d8b359cdba42d0af7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:20.899429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af34ee2a003d499d8b359cdba42d0af7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:20.902477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:20.941890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb0129-fc07-45cd-9d3f-c6ae9bc63ba1 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:20.947746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0bdc3-5d65-40ab-b6f3-c81b5456617c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:20.948605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0bdc3-5d65-40ab-b6f3-c81b5456617c service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:20.948887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0bdc3-5d65-40ab-b6f3-c81b5456617c service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:20.952705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0bdc3-5d65-40ab-b6f3-c81b5456617c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.034641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af34ee2a003d499d8b359cdba42d0af7', 'request_id': 'req-ad751796-87be-4aa9-ab1c-0558330a543f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:21.067118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af34ee2a003d499d8b359cdba42d0af7', 'request_id': 'req-ad751796-87be-4aa9-ab1c-0558330a543f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:21.101710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af34ee2a003d499d8b359cdba42d0af7', 'request_id': 'req-ad751796-87be-4aa9-ab1c-0558330a543f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:21.135573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] The token cache is being invalidate because project af34ee2a003d499d8b359cdba42d0af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:21.136343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:21.138800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:21.143338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 838/1688] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:20 2022] DELETE /identity/v3/projects/af34ee2a003d499d8b359cdba42d0af7 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:21.144674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:21.152474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0bdc3-5d65-40ab-b6f3-c81b5456617c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:21.156815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0bdc3-5d65-40ab-b6f3-c81b5456617c service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:21.160293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:21.178493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 851/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:21.180673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc92a6-f8a9-4c46-aab5-f647b541c7a4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:21.180961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc92a6-f8a9-4c46-aab5-f647b541c7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:21.181236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc92a6-f8a9-4c46-aab5-f647b541c7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.223569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1fbc92a6-f8a9-4c46-aab5-f647b541c7a4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:21.225620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1fbc92a6-f8a9-4c46-aab5-f647b541c7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:21.329058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad751796-87be-4aa9-ab1c-0558330a543f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:21.342105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:21.344420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:21.345670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:21.346157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.347993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:21.353252 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:21.380568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 852/1690] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:21.383892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7757a-4812-4e14-a55b-4783732e420d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:21.384679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7757a-4812-4e14-a55b-4783732e420d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:21.385448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7757a-4812-4e14-a55b-4783732e420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.405192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 839/1691] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:21 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:21.417792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:21.425057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:21.446853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:21.471863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-15f7757a-4812-4e14-a55b-4783732e420d None None] MFA Rules not processed for user `b6a423b67e4440628fe967429698a603`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:21.474929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-15f7757a-4812-4e14-a55b-4783732e420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:21.590855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469eac3-dd31-4046-bb1d-772b184ba401 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:21.610373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:21.611020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:21.614572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:21.614572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.617046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:21.631045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:21.681626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 853/1692] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:21.690752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308020-84ee-4260-bcef-f80d5b24b453 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:21.691045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308020-84ee-4260-bcef-f80d5b24b453 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:21.691335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308020-84ee-4260-bcef-f80d5b24b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.754009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8b308020-84ee-4260-bcef-f80d5b24b453 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:21.755238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8b308020-84ee-4260-bcef-f80d5b24b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:21.776186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 854/1693] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:21.777112 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b308020-84ee-4260-bcef-f80d5b24b453 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:21.797462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:21.803775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:21.805546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b308020-84ee-4260-bcef-f80d5b24b453 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:21.824962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:21.825600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:21.826127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:21.826405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.827064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:21.828732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:21.847438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 840/1694] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:21.848770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:21.850871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:21.867597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 855/1695] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:21.868860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:21.933865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96148-bee9-4baa-a2fc-98fc92737f75 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:21.960143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:21.961004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:21.961428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:21.961825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:21.962624 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:21.965413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:21.968217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:22.049030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 856/1696] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:22.052858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:22.079445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39ead-a44f-4a06-abb3-93caded6a024 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:22.095905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:22.097024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:22.097476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:22.097942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:22.098772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:22.108984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:22.122013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fd154-5e5d-4c96-a435-924740b214c6 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:22.149404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 857/1697] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:22.150721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:22.158728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:22.159630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:22.160055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:22.163501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:22.181597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdd5cf-20b9-43e3-831f-407ea469a3a4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:22.183926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:22.191248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:22.231256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:22.232312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:22.232620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:22.232902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:22.235895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:22.240313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 841/1698] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:22.241872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:22.245399 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:22.287847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19268-b4b5-497b-b9f6-5861195039c3 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:22.303404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaa5fd-b0a1-4214-a257-e43982ff75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:22.304192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaa5fd-b0a1-4214-a257-e43982ff75ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:22.304770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaa5fd-b0a1-4214-a257-e43982ff75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:22.305177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaa5fd-b0a1-4214-a257-e43982ff75ae admin admin] PATH_INFO: `/v3/projects/9f1f4cfadb394557bdb7cbd516da088e/users/e9fabcf7175249edb1aab149ee8a8c5e/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:22.362089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdaa5fd-b0a1-4214-a257-e43982ff75ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1f4cfadb394557bdb7cbd516da088e, user_id=e9fabcf7175249edb1aab149ee8a8c5e, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:22.365791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 858/1699] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:22 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:22.367074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:22.380320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdaa5fd-b0a1-4214-a257-e43982ff75ae admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:22.433806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 842/1700] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:22 2022] PUT /identity/v3/projects/9f1f4cfadb394557bdb7cbd516da088e/users/e9fabcf7175249edb1aab149ee8a8c5e/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:22.445220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889fc2a-66be-4b11-8e13-03060837ab4c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:22.445754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889fc2a-66be-4b11-8e13-03060837ab4c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:22.446204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889fc2a-66be-4b11-8e13-03060837ab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:22.567939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6889fc2a-66be-4b11-8e13-03060837ab4c None None] MFA Rules not processed for user `e9fabcf7175249edb1aab149ee8a8c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:22.569460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6889fc2a-66be-4b11-8e13-03060837ab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:22.583114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99c2e-4d40-43d9-8425-a8f09313662b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:22.741234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:22.765025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 843/1701] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:22.766408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644dd70-a70e-49d0-ac75-c0a07d434216 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:22.766697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644dd70-a70e-49d0-ac75-c0a07d434216 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:22.770323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644dd70-a70e-49d0-ac75-c0a07d434216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:22.853288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:22.863094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4644dd70-a70e-49d0-ac75-c0a07d434216 None None] MFA Rules not processed for user `b5955d88bb4b435fb0540698858b45a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:22.866931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4644dd70-a70e-49d0-ac75-c0a07d434216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:22.921430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:22.922083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:22.922362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:22.922638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:22.927368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:22.940775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:23.013652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 859/1702] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:22 2022] POST /identity/v3/users => generated 289 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:23.015867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:23.022811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:23.187076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 844/1703] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:23.189295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644dd70-a70e-49d0-ac75-c0a07d434216 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:23.244963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644dd70-a70e-49d0-ac75-c0a07d434216 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:23.267891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e2d0d-bdf1-4471-918f-5add9c783dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:23.268578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e2d0d-bdf1-4471-918f-5add9c783dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.268802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e2d0d-bdf1-4471-918f-5add9c783dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.269079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e2d0d-bdf1-4471-918f-5add9c783dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.269736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e2d0d-bdf1-4471-918f-5add9c783dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:23.271374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e2d0d-bdf1-4471-918f-5add9c783dfd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:23.387898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 845/1704] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:23.390147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5382-4a9d-4a0a-b36e-57e968d70686 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.394787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5382-4a9d-4a0a-b36e-57e968d70686 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.396203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5382-4a9d-4a0a-b36e-57e968d70686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.467130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12ed0-94b5-4aad-b429-e417e61a5c9b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:23.485140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-687a5382-4a9d-4a0a-b36e-57e968d70686 None None] MFA Rules not processed for user `b5955d88bb4b435fb0540698858b45a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:23.487899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:23.488609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.488912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.489217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.493752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-687a5382-4a9d-4a0a-b36e-57e968d70686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:23.523757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:23.525494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:23.536908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 846/1705] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:23.546402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a5382-4a9d-4a0a-b36e-57e968d70686 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:23.550916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 860/1706] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:23.551861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:23.565459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd45eb-5a4e-4eaf-ac09-2196ee65b05c service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:23.580815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:23.581717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.586613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.587562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.601453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:23.603263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:23.603449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a5382-4a9d-4a0a-b36e-57e968d70686 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:23.617277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 861/1707] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:23.640674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6051e-1423-4313-8a90-bb62bcaddf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:23.643725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6051e-1423-4313-8a90-bb62bcaddf0a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.644150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6051e-1423-4313-8a90-bb62bcaddf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.644541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6051e-1423-4313-8a90-bb62bcaddf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.645214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6051e-1423-4313-8a90-bb62bcaddf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:23.650015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6051e-1423-4313-8a90-bb62bcaddf0a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:23.681630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:23.696526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 847/1708] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:23.707011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104514-df92-4a3a-a66b-a637f5a32735 service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:23.720213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87edac-2b31-4f9f-b987-72d08dfd03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:23.720925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87edac-2b31-4f9f-b987-72d08dfd03df admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.721902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87edac-2b31-4f9f-b987-72d08dfd03df admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.722182 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87edac-2b31-4f9f-b987-72d08dfd03df admin admin] PATH_INFO: `/v3/projects/7dfdf4ff04e64086b8b158902412c863/users/fd173e8d8e0849a9bd8b86bd8baf5f77/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.730058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38315-100c-4a13-ae2c-853ed63586e4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.730551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38315-100c-4a13-ae2c-853ed63586e4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.730833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38315-100c-4a13-ae2c-853ed63586e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.800442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87edac-2b31-4f9f-b987-72d08dfd03df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfdf4ff04e64086b8b158902412c863, user_id=fd173e8d8e0849a9bd8b86bd8baf5f77, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:23.813416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87edac-2b31-4f9f-b987-72d08dfd03df admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:23.824222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3fd38315-100c-4a13-ae2c-853ed63586e4 None None] MFA Rules not processed for user `f2951af9ee7c4c69847685e55d1b12b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:23.831331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3fd38315-100c-4a13-ae2c-853ed63586e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:23.872784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 862/1709] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:23 2022] PUT /identity/v3/projects/7dfdf4ff04e64086b8b158902412c863/users/fd173e8d8e0849a9bd8b86bd8baf5f77/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:23.874312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329961a-bfee-4d00-a681-e6a4113778be None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:23.874854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329961a-bfee-4d00-a681-e6a4113778be None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:23.875133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329961a-bfee-4d00-a681-e6a4113778be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:23.987991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-2329961a-bfee-4d00-a681-e6a4113778be None None] MFA Rules not processed for user `fd173e8d8e0849a9bd8b86bd8baf5f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:23.997044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2329961a-bfee-4d00-a681-e6a4113778be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:24.153732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 848/1710] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:24.153732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ecd4b-fcf1-4d63-b3b9-1223167ba194 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:24.153732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ecd4b-fcf1-4d63-b3b9-1223167ba194 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:24.153732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ecd4b-fcf1-4d63-b3b9-1223167ba194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:24.294439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 863/1711] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:24.296933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329961a-bfee-4d00-a681-e6a4113778be None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:24.305951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2e9ecd4b-fcf1-4d63-b3b9-1223167ba194 None None] MFA Rules not processed for user `686afeec87d34ad8a547d81f25de2428`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:24.307293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2e9ecd4b-fcf1-4d63-b3b9-1223167ba194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:24.359537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:24.494785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:24.628370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 849/1712] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:24.641506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329961a-bfee-4d00-a681-e6a4113778be None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:24.644228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d98473-88bd-40f4-a123-6b51b62d0708 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:24.644803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d98473-88bd-40f4-a123-6b51b62d0708 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:24.645236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d98473-88bd-40f4-a123-6b51b62d0708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:24.663298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:24.675213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-98d98473-88bd-40f4-a123-6b51b62d0708 None None] MFA Rules not processed for user `686afeec87d34ad8a547d81f25de2428`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:24.677317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-98d98473-88bd-40f4-a123-6b51b62d0708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:24.677692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:24.681923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:24.682375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:24.683190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:24.692141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:24.692690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 850/1713] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:24.776584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d98473-88bd-40f4-a123-6b51b62d0708 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:24.809016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 864/1714] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:24 2022] POST /identity/v3/projects => generated 379 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:24.810078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:24.985404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d98473-88bd-40f4-a123-6b51b62d0708 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:25.037320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1189c89-a134-4765-9652-b325e5cdb519 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:25.056510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:25.059729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.059964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.060296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.061010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:25.063154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:25.137216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 865/1715] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:24 2022] POST /identity/v3/users => generated 296 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:25.152540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:25.162906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0091d9e-9d94-406d-ab03-228aca9aa2d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:25.168839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0091d9e-9d94-406d-ab03-228aca9aa2d3 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.169848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0091d9e-9d94-406d-ab03-228aca9aa2d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.170850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0091d9e-9d94-406d-ab03-228aca9aa2d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.172982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1622e-2cf8-4921-b9fc-0dfd7f81f39c admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:25.179401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:25.180102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.181614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.181614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.182279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:25.185152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:25.208038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 866/1716] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:25.209446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:25.229165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12644d-e3d9-4d0c-9d75-78b887f61611 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:25.245261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:25.246021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.246726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.247068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] PATH_INFO: `/v3/projects/27743d29d20647eb966374e7345d25cc/users/f4440bf282774427ae1828f9d198dad5/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.279609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27743d29d20647eb966374e7345d25cc, user_id=f4440bf282774427ae1828f9d198dad5, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:25.284537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:25.321581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 867/1717] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:25 2022] PUT /identity/v3/projects/27743d29d20647eb966374e7345d25cc/users/f4440bf282774427ae1828f9d198dad5/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:25.322638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:25.350701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0091d9e-9d94-406d-ab03-228aca9aa2d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:25.352372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0091d9e-9d94-406d-ab03-228aca9aa2d3 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:25.379805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 851/1718] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:25.396218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:25.437153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791086a-9091-4710-ac72-c849af2f999f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:25.444184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95461b4-1685-4649-8936-9eb74fd71cbb None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.444570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95461b4-1685-4649-8936-9eb74fd71cbb None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.444853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95461b4-1685-4649-8936-9eb74fd71cbb None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.445430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:25.446166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.446458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.446738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.447238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 852/1719] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 21 05:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:28:25.447415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:25.449351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:25.452487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b5cf-d586-4546-a823-da22aa67a0d9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.452775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b5cf-d586-4546-a823-da22aa67a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.453054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b5cf-d586-4546-a823-da22aa67a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.467185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:25.471632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 868/1720] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:25.476657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:25.507705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0975b5-254e-4219-a1f2-2f47a06bde34 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:25.519992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12030f-af1a-468a-b2f8-bf3900f9f195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:25.520963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12030f-af1a-468a-b2f8-bf3900f9f195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.523249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12030f-af1a-468a-b2f8-bf3900f9f195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.523608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12030f-af1a-468a-b2f8-bf3900f9f195 admin admin] PATH_INFO: `/v3/projects/27743d29d20647eb966374e7345d25cc/users/f4440bf282774427ae1828f9d198dad5/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.527290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12030f-af1a-468a-b2f8-bf3900f9f195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27743d29d20647eb966374e7345d25cc, user_id=f4440bf282774427ae1828f9d198dad5, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:25.538359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12030f-af1a-468a-b2f8-bf3900f9f195 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:25.554277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8b65b5cf-d586-4546-a823-da22aa67a0d9 None None] MFA Rules not processed for user `f354351c3e9d41d09ea2610b47cefa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:25.556736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8b65b5cf-d586-4546-a823-da22aa67a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:25.582988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 869/1721] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:25 2022] PUT /identity/v3/projects/27743d29d20647eb966374e7345d25cc/users/f4440bf282774427ae1828f9d198dad5/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:25.589348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:25.589770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:25.589890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:25.681691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 853/1722] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:28:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:25.683098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b5cf-d586-4546-a823-da22aa67a0d9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:25.710725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] MFA Rules not processed for user `f4440bf282774427ae1828f9d198dad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:25.711963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:25.813544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b5cf-d586-4546-a823-da22aa67a0d9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:25.896361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 870/1723] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:25.897142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:25.898868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:26.031188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201739e-2902-4a78-949f-4112e55f8c9e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:26.043777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:26.044485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:26.044775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:26.045056 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:26.071224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:26.074002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:26.093557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13e7d-f50e-47f5-a19f-21c1fe642edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:26.093818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 871/1724] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:26.094690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13e7d-f50e-47f5-a19f-21c1fe642edf service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:26.095037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13e7d-f50e-47f5-a19f-21c1fe642edf service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:26.095700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13e7d-f50e-47f5-a19f-21c1fe642edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:26.096036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:26.143296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:26.179859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13e7d-f50e-47f5-a19f-21c1fe642edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:26.183558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13e7d-f50e-47f5-a19f-21c1fe642edf service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:26.203312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 854/1725] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:26.247016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e9711-ea42-4ab2-be30-30ec45677b94 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:26.251310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c444653-8f75-4380-829d-ff0e2939decc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:26.252564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444653-8f75-4380-829d-ff0e2939decc service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:26.252852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444653-8f75-4380-829d-ff0e2939decc service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:26.253125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444653-8f75-4380-829d-ff0e2939decc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:26.269342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:26.442994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444653-8f75-4380-829d-ff0e2939decc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:26.444632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444653-8f75-4380-829d-ff0e2939decc service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:26.476003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 872/1726] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:27.069976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f93ae-01c8-42e7-b547-285d571765c9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:27.070565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f93ae-01c8-42e7-b547-285d571765c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:27.071047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f93ae-01c8-42e7-b547-285d571765c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:27.121373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-983f93ae-01c8-42e7-b547-285d571765c9 None None] MFA Rules not processed for user `b6a423b67e4440628fe967429698a603`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:27.122713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-983f93ae-01c8-42e7-b547-285d571765c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:27.170728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3678-4c88-46bf-813b-eedf980934f3 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:27.171830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3678-4c88-46bf-813b-eedf980934f3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:27.172338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3678-4c88-46bf-813b-eedf980934f3 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:27.175663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 873/1727] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 21 05:28:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:28:27.187882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093082-c32d-469f-9567-3724132323d0 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:27.188373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093082-c32d-469f-9567-3724132323d0 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:27.189255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093082-c32d-469f-9567-3724132323d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:27.234959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-66093082-c32d-469f-9567-3724132323d0 None None] MFA Rules not processed for user `f354351c3e9d41d09ea2610b47cefa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:27.241302 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-66093082-c32d-469f-9567-3724132323d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:27.262950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 874/1728] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:28:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:27.317131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 855/1729] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:27.423981 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093082-c32d-469f-9567-3724132323d0 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:27.426004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-66093082-c32d-469f-9567-3724132323d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:27.467898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f93ae-01c8-42e7-b547-285d571765c9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:27.480135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f93ae-01c8-42e7-b547-285d571765c9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:27.489212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:27.490600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:27.493851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:27.495173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:27.531873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:27.536649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:27.577259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 856/1730] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:28:27.584987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093082-c32d-469f-9567-3724132323d0 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:27.597122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77619649-9236-4dc9-8ce6-2175cb84d1c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:27.598330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619649-9236-4dc9-8ce6-2175cb84d1c8 service placement] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:27.599411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619649-9236-4dc9-8ce6-2175cb84d1c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:27.600480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619649-9236-4dc9-8ce6-2175cb84d1c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:27.605409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-77619649-9236-4dc9-8ce6-2175cb84d1c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:27.625678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77619649-9236-4dc9-8ce6-2175cb84d1c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:27.627672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77619649-9236-4dc9-8ce6-2175cb84d1c8 service placement] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:27.715734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 875/1731] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:28.655980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:28.688207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702bd83-f30c-481f-b940-a6c93b7f61ea service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:28.705875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f3d2f-6b50-419d-9872-d5593fc87f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:28.708492 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3d2f-6b50-419d-9872-d5593fc87f9c service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:28.709013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3d2f-6b50-419d-9872-d5593fc87f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:28.709673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3d2f-6b50-419d-9872-d5593fc87f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:28.731505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f3d2f-6b50-419d-9872-d5593fc87f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:28.736037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f3d2f-6b50-419d-9872-d5593fc87f9c service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:28.796846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 857/1732] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:29.946582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de4d03-bf08-4c93-8441-1f7606b41bf3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:29.947063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de4d03-bf08-4c93-8441-1f7606b41bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:29.947222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de4d03-bf08-4c93-8441-1f7606b41bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:30.037183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-63de4d03-bf08-4c93-8441-1f7606b41bf3 None None] MFA Rules not processed for user `686afeec87d34ad8a547d81f25de2428`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:30.048145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-63de4d03-bf08-4c93-8441-1f7606b41bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:30.069817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 876/1733] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:31.504131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:31.504640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:31.504640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:31.586417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de4d03-bf08-4c93-8441-1f7606b41bf3 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:31.795839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:31.807736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:31.856151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de4d03-bf08-4c93-8441-1f7606b41bf3 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:31.866133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:31.866974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:31.867423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:31.868860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] PATH_INFO: `/v3/users/e9fabcf7175249edb1aab149ee8a8c5e` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:31.873938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9fabcf7175249edb1aab149ee8a8c5e)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:31.876919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:32.026364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:32.064541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9fabcf7175249edb1aab149ee8a8c5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.085570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9fabcf7175249edb1aab149ee8a8c5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.086316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9fabcf7175249edb1aab149ee8a8c5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.087591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 858/1734] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 585 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:32.088671 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:32.095450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:32.122760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9fabcf7175249edb1aab149ee8a8c5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.132409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9f550-4ef5-45df-a2c9-d858f67fff6b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:32.146909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:32.147894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:32.148362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:32.149379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] PATH_INFO: `/v3/users/d8046b26c22e4492aac5e427a52f2dd3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:32.151927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8046b26c22e4492aac5e427a52f2dd3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:32.154156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:32.182949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4633ed70-a048-4ba4-8568-0dd09497005f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9fabcf7175249edb1aab149ee8a8c5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.197694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 877/1735] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:31 2022] DELETE /identity/v3/users/e9fabcf7175249edb1aab149ee8a8c5e => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:32.199272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0463c-5a1a-4af8-bd75-3a0023f69e96 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:32.199717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0463c-5a1a-4af8-bd75-3a0023f69e96 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:32.204757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0463c-5a1a-4af8-bd75-3a0023f69e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:32.229871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:32.255251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c7f0463c-5a1a-4af8-bd75-3a0023f69e96 None None] MFA Rules not processed for user `f2951af9ee7c4c69847685e55d1b12b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:32.264154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c7f0463c-5a1a-4af8-bd75-3a0023f69e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:32.293439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8046b26c22e4492aac5e427a52f2dd3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.317019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8046b26c22e4492aac5e427a52f2dd3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.318965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8046b26c22e4492aac5e427a52f2dd3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.362771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8046b26c22e4492aac5e427a52f2dd3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.378544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-554579cc-ab5f-4c3a-933f-b4349d1d703b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8046b26c22e4492aac5e427a52f2dd3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:32.397904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 859/1736] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:32 2022] DELETE /identity/v3/users/d8046b26c22e4492aac5e427a52f2dd3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:32.399217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:32.399500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:32.400853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:32.481224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:32.482485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:32.491735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 878/1737] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:32.493518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:32.496257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:32.496815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:32.598394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:32.606421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:32.679502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 860/1738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:32.682373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:32.686525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:32.776747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 879/1739] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:32.776917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:32.783472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:33.047294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a55052-3c1d-41a4-a5fa-664fa4be7567 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:33.060633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:33.062815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:33.065191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:33.065944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358ef46-3f42-40ec-9766-69022c6751fa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:33.066827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:33.090094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:33.093663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:33.100096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:33.102497 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:33.103054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:33.103554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:33.107324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:33.107993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:33.121185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 880/1740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:33.122068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:33.126256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:33.143790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd096a6-6e9f-4762-8f16-428d819e0fb3 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:33.150394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:33.151312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:33.151770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:33.152430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:33.153059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:33.168247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:33.170245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:33.188825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 881/1741] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:33.245199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:33.247822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:33.275483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 861/1742] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:28:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:28:34.081650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:34.087792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:34.125185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10469e6-793b-4c7c-b31e-e5634ca4bd58 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:34.137932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:34.138995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:34.148169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:34.148169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] PATH_INFO: `/v3/users/fd173e8d8e0849a9bd8b86bd8baf5f77` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:34.158986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd173e8d8e0849a9bd8b86bd8baf5f77)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:34.176662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:34.371557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:34.374223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:34.418648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8bcf-3cf7-4d31-8b08-1e7516098e18 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:34.428699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd173e8d8e0849a9bd8b86bd8baf5f77'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.446149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:34.450100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:34.450758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:34.451331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd173e8d8e0849a9bd8b86bd8baf5f77'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.451881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] PATH_INFO: `/v3/projects/42422242ffb94f2a9a56e5a2d733ade3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:34.452762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd173e8d8e0849a9bd8b86bd8baf5f77'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.460965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42422242ffb94f2a9a56e5a2d733ade3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:34.464489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:34.478035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd173e8d8e0849a9bd8b86bd8baf5f77'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.510802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5d2863e4-9936-4dcf-83e7-2934bdfb454d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd173e8d8e0849a9bd8b86bd8baf5f77'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.526384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 882/1743] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:34 2022] DELETE /identity/v3/users/fd173e8d8e0849a9bd8b86bd8baf5f77 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:34.527834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:34.543302 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:34.543641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:34.635889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:34.637184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:34.670521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42422242ffb94f2a9a56e5a2d733ade3', 'request_id': 'req-2770cd2e-cd99-4762-aa81-670d1299a386'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.695726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42422242ffb94f2a9a56e5a2d733ade3', 'request_id': 'req-2770cd2e-cd99-4762-aa81-670d1299a386'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.738629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42422242ffb94f2a9a56e5a2d733ade3', 'request_id': 'req-2770cd2e-cd99-4762-aa81-670d1299a386'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.785714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] The token cache is being invalidate because project 42422242ffb94f2a9a56e5a2d733ade3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:34.786010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.788623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2770cd2e-cd99-4762-aa81-670d1299a386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:34.795723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 862/1744] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:34 2022] DELETE /identity/v3/projects/42422242ffb94f2a9a56e5a2d733ade3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:28:34.800822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:34.805170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:34.805997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:34.879811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 883/1745] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:34.884203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:34.890597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:34.895064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] MFA Rules not processed for user `f354351c3e9d41d09ea2610b47cefa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:34.897473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:34.932155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2cfe-dc48-4361-a1a2-8920c56efed1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:34.956914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:34.958356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:34.959058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:34.960469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] PATH_INFO: `/v3/users/f15f4de707974744ae6ea33e5a8f785b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:34.966548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15f4de707974744ae6ea33e5a8f785b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:34.990822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:35.082674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 863/1746] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Sep 21 05:28:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:35.091313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:35.095562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:35.139977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15f4de707974744ae6ea33e5a8f785b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.142393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1e97-380d-4266-82d8-84c4f099a061 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:35.153787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:35.154152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:35.154858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:35.155587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:35.158957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15f4de707974744ae6ea33e5a8f785b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.160329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15f4de707974744ae6ea33e5a8f785b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.164667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:35.169800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:35.191678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15f4de707974744ae6ea33e5a8f785b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.202749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:35.206279 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:35.220743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15f4de707974744ae6ea33e5a8f785b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.233811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 864/1747] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:35.234716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:35.238102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 884/1748] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:34 2022] DELETE /identity/v3/users/f15f4de707974744ae6ea33e5a8f785b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:35.238102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:35.238329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:35.239805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:35.267759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b88dc1-0550-4a87-8c0d-62ac90c21b2c service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:35.373317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:35.430914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:35.434319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:35.434878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:35.436009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] PATH_INFO: `/v3/projects/9f1f4cfadb394557bdb7cbd516da088e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:35.440873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1f4cfadb394557bdb7cbd516da088e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:35.441755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e170d3-6b73-413a-8c7d-a2adbfe2f53f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:35.443507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:35.469185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76343-8dd0-41a9-bb3a-ea8da2f5174c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:35.469774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76343-8dd0-41a9-bb3a-ea8da2f5174c service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:35.471856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76343-8dd0-41a9-bb3a-ea8da2f5174c service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:35.472143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76343-8dd0-41a9-bb3a-ea8da2f5174c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:35.482470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-57b76343-8dd0-41a9-bb3a-ea8da2f5174c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:35.524955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b76343-8dd0-41a9-bb3a-ea8da2f5174c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:35.529508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b76343-8dd0-41a9-bb3a-ea8da2f5174c service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:35.562960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 885/1749] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:35.629642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1f4cfadb394557bdb7cbd516da088e', 'request_id': 'req-915abd70-53c2-40a2-9df7-efb70ed5d5bf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.673724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1f4cfadb394557bdb7cbd516da088e', 'request_id': 'req-915abd70-53c2-40a2-9df7-efb70ed5d5bf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.690972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1f4cfadb394557bdb7cbd516da088e', 'request_id': 'req-915abd70-53c2-40a2-9df7-efb70ed5d5bf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.708244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] The token cache is being invalidate because project 9f1f4cfadb394557bdb7cbd516da088e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:35.708472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.709438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-915abd70-53c2-40a2-9df7-efb70ed5d5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:35.715644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 865/1750] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:35 2022] DELETE /identity/v3/projects/9f1f4cfadb394557bdb7cbd516da088e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:35.721921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d163e-f08c-41e1-aac9-13c468cc1a2b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:35.722851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d163e-f08c-41e1-aac9-13c468cc1a2b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:35.723414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d163e-f08c-41e1-aac9-13c468cc1a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:35.760782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8e9d163e-f08c-41e1-aac9-13c468cc1a2b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:35.762778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8e9d163e-f08c-41e1-aac9-13c468cc1a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:35.973097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 886/1751] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:35.983360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce268-2b05-4798-8f43-068545d3ebde None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:35.991053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce268-2b05-4798-8f43-068545d3ebde None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:35.991743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce268-2b05-4798-8f43-068545d3ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:36.037534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2dbce268-2b05-4798-8f43-068545d3ebde None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:36.057167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2dbce268-2b05-4798-8f43-068545d3ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:36.085972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 866/1752] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:36.090041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d163e-f08c-41e1-aac9-13c468cc1a2b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:36.108630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d163e-f08c-41e1-aac9-13c468cc1a2b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:36.117555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:36.118917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:36.120366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:36.121871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:36.122953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:36.123486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:36.126634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:36.150891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce268-2b05-4798-8f43-068545d3ebde None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:36.152323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 887/1753] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:36.161975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce268-2b05-4798-8f43-068545d3ebde None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:36.201041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:36.201718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:36.202040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:36.202260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:36.202948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:36.205004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:36.296465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 867/1754] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:36 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:36.299044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:36.331541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a97b9-1c7a-4b62-96cb-c60e21bbd490 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:36.538196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:36.538930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:36.539259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:36.541710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:36.542534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:36.552907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:36.580383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:36.615732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:36.629765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 888/1755] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:36 2022] POST /identity/v3/users => generated 287 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:36.644978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926301d-a64c-4525-964d-ce8cc9a9f95a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:36.661694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:36.669529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:36.669823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:36.670101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:36.670781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:36.678321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:36.717507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:36.728390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 868/1756] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:36.739111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270a628-3c3e-4e8d-b10c-1f3580495283 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:36.756228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4317-8df0-48c0-afbe-9f5e028afaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:36.757743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4317-8df0-48c0-afbe-9f5e028afaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:36.758035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4317-8df0-48c0-afbe-9f5e028afaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:36.760259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4317-8df0-48c0-afbe-9f5e028afaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:36.761172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e4317-8df0-48c0-afbe-9f5e028afaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:36.765741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e4317-8df0-48c0-afbe-9f5e028afaf7 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:36.803467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 889/1757] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:28:36.808052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:36.830082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138747a-d418-46b4-bc9c-9d5d1910ca9d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:36.867666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:36.869540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:36.871837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:36.872516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] PATH_INFO: `/v3/projects/84c5689667544fd7b183ccfccf48e6ca/users/6b51a1571a6d4af389ce2702e6b92bbf/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:36.918687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c5689667544fd7b183ccfccf48e6ca, user_id=6b51a1571a6d4af389ce2702e6b92bbf, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:36.921766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:36.970112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 869/1758] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:36 2022] PUT /identity/v3/projects/84c5689667544fd7b183ccfccf48e6ca/users/6b51a1571a6d4af389ce2702e6b92bbf/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:36.981607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf50a-5a0f-4699-a13b-868ca707040a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:36.981909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf50a-5a0f-4699-a13b-868ca707040a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:36.982160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf50a-5a0f-4699-a13b-868ca707040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:37.051723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c21cf50a-5a0f-4699-a13b-868ca707040a None None] MFA Rules not processed for user `6b51a1571a6d4af389ce2702e6b92bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:37.053517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c21cf50a-5a0f-4699-a13b-868ca707040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:37.419937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 890/1759] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:37.562909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:37.566434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:37.751033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2f65-e703-4a51-932e-8b9c344e87f7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:37.774614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:37.775289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:37.775572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:37.775848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] PATH_INFO: `/v3/projects/7dfdf4ff04e64086b8b158902412c863` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:37.777403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfdf4ff04e64086b8b158902412c863)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:37.779433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:37.852683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:38.024749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfdf4ff04e64086b8b158902412c863', 'request_id': 'req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.054935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfdf4ff04e64086b8b158902412c863', 'request_id': 'req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.083787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfdf4ff04e64086b8b158902412c863', 'request_id': 'req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.137069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] The token cache is being invalidate because project 7dfdf4ff04e64086b8b158902412c863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:38.137339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.144855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.146929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 870/1760] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:37 2022] DELETE /identity/v3/projects/7dfdf4ff04e64086b8b158902412c863 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:38.150960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cf50a-5a0f-4699-a13b-868ca707040a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:38.168766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cf50a-5a0f-4699-a13b-868ca707040a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:38.352778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:38.353429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:38.353742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:38.354037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] PATH_INFO: `/v3/users/f4440bf282774427ae1828f9d198dad5` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:38.356151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4440bf282774427ae1828f9d198dad5)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:38.369500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:38.489370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:38.491453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:38.529619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ec1a-765d-4eda-a73f-b0b007b7c2d7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:38.550990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4440bf282774427ae1828f9d198dad5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.557380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4440bf282774427ae1828f9d198dad5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.558392 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4440bf282774427ae1828f9d198dad5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.559578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:38.561200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:38.561493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:38.561915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] PATH_INFO: `/v3/projects/59bc3ffd3d274286b39253a9148406da` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:38.565077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bc3ffd3d274286b39253a9148406da)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:38.573658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:38.586352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4440bf282774427ae1828f9d198dad5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.642047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:38.672947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3a829028-8d6e-44e8-b552-47b60c25e4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4440bf282774427ae1828f9d198dad5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.706538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 891/1761] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:38 2022] DELETE /identity/v3/users/f4440bf282774427ae1828f9d198dad5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:38.743840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bc3ffd3d274286b39253a9148406da', 'request_id': 'req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.768575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bc3ffd3d274286b39253a9148406da', 'request_id': 'req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.776582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bc3ffd3d274286b39253a9148406da', 'request_id': 'req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.814172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] The token cache is being invalidate because project 59bc3ffd3d274286b39253a9148406da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:38.814940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.815973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-11bb7465-edc0-4e44-a8cc-2cf7611f8fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:38.827762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718415ba-c325-4225-8309-388c4b5fe97e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:38.828457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718415ba-c325-4225-8309-388c4b5fe97e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:38.829099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718415ba-c325-4225-8309-388c4b5fe97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:38.837251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 871/1762] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:38 2022] DELETE /identity/v3/projects/59bc3ffd3d274286b39253a9148406da => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:38.942093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-718415ba-c325-4225-8309-388c4b5fe97e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:38.954310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-718415ba-c325-4225-8309-388c4b5fe97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:39.144748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab12627-b3bd-44cd-8b83-92a0e2d2fc85 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:39.145328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab12627-b3bd-44cd-8b83-92a0e2d2fc85 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:39.147310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab12627-b3bd-44cd-8b83-92a0e2d2fc85 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:39.149618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 872/1763] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:28:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:28:39.240145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 892/1764] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:39.248756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac2b3-17d2-45bb-aa95-b81fe4bbe405 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:39.249111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac2b3-17d2-45bb-aa95-b81fe4bbe405 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:39.249813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac2b3-17d2-45bb-aa95-b81fe4bbe405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:39.296197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698487-45a6-4d49-ab03-9cb5b804a594 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:39.296771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698487-45a6-4d49-ab03-9cb5b804a594 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:39.297211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698487-45a6-4d49-ab03-9cb5b804a594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:39.326055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a2cac2b3-17d2-45bb-aa95-b81fe4bbe405 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:39.326850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2cac2b3-17d2-45bb-aa95-b81fe4bbe405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:39.345296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-bb698487-45a6-4d49-ab03-9cb5b804a594 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:39.346637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bb698487-45a6-4d49-ab03-9cb5b804a594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:39.361390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 873/1765] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:39.365923 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac2b3-17d2-45bb-aa95-b81fe4bbe405 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:39.418781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac2b3-17d2-45bb-aa95-b81fe4bbe405 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:39.438536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:39.439174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:39.439524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:39.439938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:39.440763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:39.440971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:39.442702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:39.488487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 874/1766] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:28:39.490684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:39.502922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:39.601772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 893/1767] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:28:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:39.603221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb698487-45a6-4d49-ab03-9cb5b804a594 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:39.638797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb698487-45a6-4d49-ab03-9cb5b804a594 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:39.654759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:39.655437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:39.655800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:39.656161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:39.656817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:39.665815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:39.757979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:39.769875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 894/1768] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:39 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:39.775367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:39.813058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4e9d7-b796-43c2-8c34-c56223455b70 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:39.900926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122666a2-b798-41e9-95dc-b0dde7704902 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:39.907773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:39.908466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:39.908714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:39.908993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:39.910697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:39.922434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:39.945853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:39.980223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:39.980473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 895/1769] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:39 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:39.980568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:39.980568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:39.983148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:39.984932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:39.990486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:40.018878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fe5cf-fae7-4045-832f-d82cbcd9c2f0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:40.039599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:40.042344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:40.043314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:40.044733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:40.045597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:40.048366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:40.085734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 896/1770] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:40.087752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:40.122022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae9f0-e4d5-4e19-b461-c6851f6ab340 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:40.139867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:40.140616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:40.140907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:40.141187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:40.145038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:40.146831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:40.169257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:40.171132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:40.185246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 875/1771] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:40.187435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 897/1772] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:40.207649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:40.222633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49f6df-f6fc-4a1e-af55-cac934250cad service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:40.239196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:40.239439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb5fc-9bda-4cde-90c7-8cba7459d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:40.240094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb5fc-9bda-4cde-90c7-8cba7459d797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:40.240566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb5fc-9bda-4cde-90c7-8cba7459d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:40.240908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb5fc-9bda-4cde-90c7-8cba7459d797 admin admin] PATH_INFO: `/v3/projects/ca1e2f607845423f8f0aab1ba9b36578/users/0941eb53a46b443fb8737e9964ab48d7/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:40.269352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91e9f-b77a-4ca1-9557-ae3f407078ba admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:40.292838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:40.293390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:40.293673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:40.293954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:40.294590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfb5fc-9bda-4cde-90c7-8cba7459d797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1e2f607845423f8f0aab1ba9b36578, user_id=0941eb53a46b443fb8737e9964ab48d7, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:40.297585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfb5fc-9bda-4cde-90c7-8cba7459d797 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:40.320774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:40.323143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:40.337928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 876/1773] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:40 2022] PUT /identity/v3/projects/ca1e2f607845423f8f0aab1ba9b36578/users/0941eb53a46b443fb8737e9964ab48d7/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:28:40.351846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:40.352891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:40.353243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:40.367736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 898/1774] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:40.457371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] MFA Rules not processed for user `0941eb53a46b443fb8737e9964ab48d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:40.459310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:40.604047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:40.626206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 877/1775] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:40.626371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:40.644376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c5485-fd92-4a71-962b-d2bc7e095af8 service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:40.905568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:40.906355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:40.906571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:40.906859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:40.907588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:40.912929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:40.915121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:40.926646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:40.940989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e073da9-b2fe-40cc-b3a3-f142f547bc1c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:40.955144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:40.955973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:40.956260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:40.956577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] PATH_INFO: `/v3/projects/27743d29d20647eb966374e7345d25cc` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:40.964804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27743d29d20647eb966374e7345d25cc)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:40.973554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:41.030182 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 899/1776] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:40 2022] POST /identity/v3/projects => generated 375 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:41.030978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:41.177420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27743d29d20647eb966374e7345d25cc', 'request_id': 'req-9efabc8b-f3b8-49ae-8828-67e3606837e4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:41.207677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27743d29d20647eb966374e7345d25cc', 'request_id': 'req-9efabc8b-f3b8-49ae-8828-67e3606837e4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:41.217047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27743d29d20647eb966374e7345d25cc', 'request_id': 'req-9efabc8b-f3b8-49ae-8828-67e3606837e4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:41.217236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c40f5a-94e1-43c8-99f7-1c1a315ca7bf admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:41.253675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] The token cache is being invalidate because project 27743d29d20647eb966374e7345d25cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:41.255920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:41.257630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9efabc8b-f3b8-49ae-8828-67e3606837e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:41.260646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 878/1777] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:40 2022] DELETE /identity/v3/projects/27743d29d20647eb966374e7345d25cc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:41.266308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3176d-4a3d-429d-9d52-22f923fa8801 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:41.266933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3176d-4a3d-429d-9d52-22f923fa8801 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:41.267355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3176d-4a3d-429d-9d52-22f923fa8801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:41.303167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7bd3176d-4a3d-429d-9d52-22f923fa8801 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:41.304496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7bd3176d-4a3d-429d-9d52-22f923fa8801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:41.329092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:41.356310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:41.357048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:41.357398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:41.357747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:41.358656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:41.361088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:41.399352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 900/1778] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:41 2022] POST /identity/v3/users => generated 294 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:41.413458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:41.420742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:41.446160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 879/1779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:41.455469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9a55-9ac2-490e-9b57-a0fdfeb698f7 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:41.459358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7b228-0987-4f8e-8694-f26c997104c8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:41.460899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7b228-0987-4f8e-8694-f26c997104c8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:41.462335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7b228-0987-4f8e-8694-f26c997104c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:41.497149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:41.498465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:41.498601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:41.504751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:41.513805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:41.520103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:41.529343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a2c7b228-0987-4f8e-8694-f26c997104c8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:41.534797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2c7b228-0987-4f8e-8694-f26c997104c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:41.558738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 880/1780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:41.564447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7b228-0987-4f8e-8694-f26c997104c8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:41.584355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7b228-0987-4f8e-8694-f26c997104c8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:41.594210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 901/1781] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:41.599041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:41.601432 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:41.601716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:41.602154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:41.602451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:41.603153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:41.603476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:41.605289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:41.632205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1203c7-abc0-4f5b-a3da-84feed10d8dc admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:41.638736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 881/1782] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:41.640480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:41.657361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:41.658385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:41.658385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:41.658627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] PATH_INFO: `/v3/projects/27600aebf352496da8a10ba10cab9ca1/users/b04ef0bcf1994d2aa36212977d4e78c9/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:41.686282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985c700-3047-4046-b151-2f77cccbd8f8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:41.722075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:41.722714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:41.723063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:41.723457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:41.724865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:41.730862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:41.750115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27600aebf352496da8a10ba10cab9ca1, user_id=b04ef0bcf1994d2aa36212977d4e78c9, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:41.752865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:41.778802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 902/1783] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:41 2022] PUT /identity/v3/projects/27600aebf352496da8a10ba10cab9ca1/users/b04ef0bcf1994d2aa36212977d4e78c9/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:41.782869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:41.807231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 882/1784] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:41 2022] POST /identity/v3/projects => generated 409 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:41.813460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:42.080458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:42.123178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd3e7-e34f-406d-9be3-157a7e22539c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:42.143818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:42.144696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.146663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.146951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.155264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:42.160790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:42.197684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf92e-e4b7-4d2f-b783-fd81be821812 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:42.237168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 883/1785] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:41 2022] POST /identity/v3/users => generated 305 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:28:42.243843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:42.254694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:42.257837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.258533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.259851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.261032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:42.266464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:42.294391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd069b87-7421-4ee8-8e9d-994f17c7015e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:42.297095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 903/1786] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:42.300098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:42.318304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:42.318790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.320440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.320729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.321395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:42.323233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:42.355657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6238c-f304-472f-aa35-7f610a1148a3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:42.362440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 884/1787] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:42.368989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:42.372205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d639c23-09c4-4be6-9e7f-23424a47764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:42.372979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639c23-09c4-4be6-9e7f-23424a47764c admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.375842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639c23-09c4-4be6-9e7f-23424a47764c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.376186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639c23-09c4-4be6-9e7f-23424a47764c admin admin] PATH_INFO: `/v3/projects/27600aebf352496da8a10ba10cab9ca1/users/b04ef0bcf1994d2aa36212977d4e78c9/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.382628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d639c23-09c4-4be6-9e7f-23424a47764c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27600aebf352496da8a10ba10cab9ca1, user_id=b04ef0bcf1994d2aa36212977d4e78c9, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:42.387185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d639c23-09c4-4be6-9e7f-23424a47764c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:42.395824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409eb9c-2d8f-408b-9f2f-254ccbe08da4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:42.412608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:42.414535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.415026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.415509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.416389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:42.418224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:42.425893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 904/1788] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:42 2022] PUT /identity/v3/projects/27600aebf352496da8a10ba10cab9ca1/users/b04ef0bcf1994d2aa36212977d4e78c9/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:42.429595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.429952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.430234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.450138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 885/1789] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:42.452182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:42.463544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214cff4-2511-4641-b727-8bae654585e6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:42.511921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] MFA Rules not processed for user `b04ef0bcf1994d2aa36212977d4e78c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:42.514316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:42.557551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d2ad7-a5e0-4de6-9e55-eeebd2bbc887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:42.558453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d2ad7-a5e0-4de6-9e55-eeebd2bbc887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.558845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d2ad7-a5e0-4de6-9e55-eeebd2bbc887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.559681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d2ad7-a5e0-4de6-9e55-eeebd2bbc887 admin admin] PATH_INFO: `/v3/projects/c1245dbeee0141708f9531cc8195ba9e/users/c6a5ba7ad9104074a46d918616d17f9b/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.600129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d2ad7-a5e0-4de6-9e55-eeebd2bbc887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1245dbeee0141708f9531cc8195ba9e, user_id=c6a5ba7ad9104074a46d918616d17f9b, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:42.603751 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d2ad7-a5e0-4de6-9e55-eeebd2bbc887 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:42.630922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 905/1790] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:42.643061 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:42.644654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 886/1791] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:42 2022] PUT /identity/v3/projects/c1245dbeee0141708f9531cc8195ba9e/users/c6a5ba7ad9104074a46d918616d17f9b/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:42.657516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:42.660461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.661013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.661362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.693083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:42.758020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] MFA Rules not processed for user `c6a5ba7ad9104074a46d918616d17f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:42.762948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c8391-e62f-4545-9d26-8a0d68660080 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:42.766214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:42.888335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:42.888967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:42.889274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:42.889516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:42.895169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:42.980657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 887/1792] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:42 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:42.982329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:42.986811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:43.066898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:43.080850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:43.088924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:43.114569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 906/1793] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:28:43.116475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:43.170393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c67e1c-db9e-4859-8075-135a5852dd01 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:43.183549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:43.184873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:43.185254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:43.186966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] PATH_INFO: `/v3/users/6b51a1571a6d4af389ce2702e6b92bbf` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:43.188620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b51a1571a6d4af389ce2702e6b92bbf)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:43.191740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:43.268078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db25b-b496-46b1-bc0b-c973e77c9084 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:43.286414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:43.290200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:43.290905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:43.291484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:43.293986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:43.300067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:43.304048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b51a1571a6d4af389ce2702e6b92bbf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:43.319111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b51a1571a6d4af389ce2702e6b92bbf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:43.320637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b51a1571a6d4af389ce2702e6b92bbf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:43.344998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b51a1571a6d4af389ce2702e6b92bbf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:43.357808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4dedb580-affc-483c-8b87-70046089ad51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b51a1571a6d4af389ce2702e6b92bbf'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:43.383158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 888/1794] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:42 2022] DELETE /identity/v3/users/6b51a1571a6d4af389ce2702e6b92bbf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:43.387622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:43.388015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:43.389501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:43.400203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 907/1795] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:43 2022] POST /identity/v3/projects => generated 407 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:43.404329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:43.411201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:43.425936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:43.445935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:43.449912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:43.609430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222028-b600-4828-8a76-a722ccf84506 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:43.630240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:43.633988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:43.634230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:43.634534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:43.635455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:43.647793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:43.653936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 889/1796] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:43.674108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:43.675931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:43.717501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 908/1797] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:43 2022] POST /identity/v3/users => generated 310 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:28:43.718764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:43.759847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a871dfb-e53f-4210-8566-b34372e7e125 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:43.782429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:43.783285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:43.783567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:43.785539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:43.786243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:43.788028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:43.832154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 909/1798] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:43.833195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:43.842003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:43.882505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502a54-f186-438d-b2d7-413be8ffffb3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:43.885601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b56ed-886b-46f1-bc1e-fcc722c850e3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:43.896216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:43.896968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:43.897262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:43.897541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:43.916347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:43.916347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:43.916347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:43.916347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] PATH_INFO: `/v3/projects/44d5f1abf1d14e56b11eb6c94e47b1c0/users/58dbfc5cf11f44c08669381c5349b184/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:43.934882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:43.936374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:43.958283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d5f1abf1d14e56b11eb6c94e47b1c0, user_id=58dbfc5cf11f44c08669381c5349b184, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:43.962628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:43.968575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 890/1799] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:28:43.997728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 910/1800] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:43 2022] PUT /identity/v3/projects/44d5f1abf1d14e56b11eb6c94e47b1c0/users/58dbfc5cf11f44c08669381c5349b184/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:43.998937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:44.012879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2b11-4dd5-43a9-8e6f-2abde8081118 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:44.207507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53934f-1e82-42f5-8085-ac50ae8061e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:44.208241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53934f-1e82-42f5-8085-ac50ae8061e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:44.208998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53934f-1e82-42f5-8085-ac50ae8061e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:44.209258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53934f-1e82-42f5-8085-ac50ae8061e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:44.209905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53934f-1e82-42f5-8085-ac50ae8061e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:44.211520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53934f-1e82-42f5-8085-ac50ae8061e0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:44.240976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 891/1801] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:44.245452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:44.260144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0108a-19f3-4dd1-a4a8-9273a2a00be6 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:44.276032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05472186-2c41-460b-913f-45233766e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:44.276817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472186-2c41-460b-913f-45233766e315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:44.277098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472186-2c41-460b-913f-45233766e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:44.277416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472186-2c41-460b-913f-45233766e315 admin admin] PATH_INFO: `/v3/projects/44d5f1abf1d14e56b11eb6c94e47b1c0/users/58dbfc5cf11f44c08669381c5349b184/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:44.289361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472186-2c41-460b-913f-45233766e315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d5f1abf1d14e56b11eb6c94e47b1c0, user_id=58dbfc5cf11f44c08669381c5349b184, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:44.292058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472186-2c41-460b-913f-45233766e315 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:44.348341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 911/1802] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:44 2022] PUT /identity/v3/projects/44d5f1abf1d14e56b11eb6c94e47b1c0/users/58dbfc5cf11f44c08669381c5349b184/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:44.353022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:44.353493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:44.353790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:44.419828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] MFA Rules not processed for user `58dbfc5cf11f44c08669381c5349b184`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:44.421074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:44.682525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 892/1803] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:44 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:44.698452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05472186-2c41-460b-913f-45233766e315 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:44.700549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-05472186-2c41-460b-913f-45233766e315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:44.890616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05472186-2c41-460b-913f-45233766e315 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:44.895039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072fb04-7775-4a48-baa3-8354f8795f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:44.899575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fb04-7775-4a48-baa3-8354f8795f79 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:44.899916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fb04-7775-4a48-baa3-8354f8795f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:44.900244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fb04-7775-4a48-baa3-8354f8795f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:44.922319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072fb04-7775-4a48-baa3-8354f8795f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:44.923804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072fb04-7775-4a48-baa3-8354f8795f79 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:44.969365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 912/1804] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:44 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:45.892954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:45.894990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:45.921305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48038f-6236-464b-82eb-3fde561cf851 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:45.936573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:45.938495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:45.945090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:45.946849 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:45.962467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:46.171651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:46.173417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:46.202853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 893/1805] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:45 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:46.553927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c255d3b-b16a-40a9-84be-5aaead65eaea None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:46.555157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c255d3b-b16a-40a9-84be-5aaead65eaea None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:46.556954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c255d3b-b16a-40a9-84be-5aaead65eaea None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:46.560735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 913/1806] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:28:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:28:46.575310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:46.576894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:46.583568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:46.588546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de81ece-cbe9-44ce-803a-27f4885a2098 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:46.588951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de81ece-cbe9-44ce-803a-27f4885a2098 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:46.589333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de81ece-cbe9-44ce-803a-27f4885a2098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:46.621061 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8de81ece-cbe9-44ce-803a-27f4885a2098 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:46.622660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8de81ece-cbe9-44ce-803a-27f4885a2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:46.703723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:46.760548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ac7e1-471f-48cc-a264-10bd745bf16e service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:46.763715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 914/1807] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:28:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:46.778318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:46.780307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:46.780723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:46.781055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] PATH_INFO: `/v3/projects/84c5689667544fd7b183ccfccf48e6ca` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:46.783351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c5689667544fd7b183ccfccf48e6ca)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:46.795457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:46.912360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c5689667544fd7b183ccfccf48e6ca', 'request_id': 'req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:46.920955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c5689667544fd7b183ccfccf48e6ca', 'request_id': 'req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:46.930833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c5689667544fd7b183ccfccf48e6ca', 'request_id': 'req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:46.949997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] The token cache is being invalidate because project 84c5689667544fd7b183ccfccf48e6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:46.950362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:46.951326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5e165ba2-3c03-4c54-9e24-a3fa7291ad56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:46.953783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 894/1808] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:46 2022] DELETE /identity/v3/projects/84c5689667544fd7b183ccfccf48e6ca => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:46.958365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35c9c9-1bdd-4bee-937b-bd4504901d63 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:46.958683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35c9c9-1bdd-4bee-937b-bd4504901d63 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:46.958955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35c9c9-1bdd-4bee-937b-bd4504901d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:46.986698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4a35c9c9-1bdd-4bee-937b-bd4504901d63 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:46.988793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4a35c9c9-1bdd-4bee-937b-bd4504901d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:47.094184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 915/1809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:47.102834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed546a0-e6ca-4c9b-8e47-baa7365357c0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.103635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed546a0-e6ca-4c9b-8e47-baa7365357c0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.103980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed546a0-e6ca-4c9b-8e47-baa7365357c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.128812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0ed546a0-e6ca-4c9b-8e47-baa7365357c0 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:47.131196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0ed546a0-e6ca-4c9b-8e47-baa7365357c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:47.143314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 895/1810] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:47.145825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35c9c9-1bdd-4bee-937b-bd4504901d63 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.160337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35c9c9-1bdd-4bee-937b-bd4504901d63 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.166434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.167040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.167316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.167850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.168228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:47.168573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.170157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.186683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 916/1811] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:47.188595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed546a0-e6ca-4c9b-8e47-baa7365357c0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.205689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed546a0-e6ca-4c9b-8e47-baa7365357c0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.216143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.218145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.218436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.218715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.219374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.223661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.268936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 896/1812] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:47 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:47.278229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.278829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.282263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:47.303941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ccf81-74f3-4a8c-85db-738ee9e03d36 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.398507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:47.404081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e7e7-ef01-4662-af03-8560c903dad8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.415046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.415672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.416319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.416710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.420944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:47.435873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.437583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.461509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 897/1813] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:47.462715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.467691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:47.485726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.486660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.487152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.488191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.489175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.492828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.532222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 917/1814] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:47 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:47.533804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.548524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa65a57-b42b-4a60-ba2c-82e969d6a72a admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.555047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.555679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.557340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.557340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.557340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.559105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.575496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 918/1815] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:47.576541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.596358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3b392-a2f1-4315-b35e-69eb8e4d1742 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.610425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.611337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.611783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.613016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.615181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.617357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.632676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6dcf9-002d-4cce-93be-0c65efa0f261 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.640192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 919/1816] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:47.641222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.645440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.646753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.647284 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.648107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.650869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:47.653961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7f15a-fcc4-40d4-8a35-f909fa76f381 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.659758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7909fa-9a8e-4821-806d-b4b26b24820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.660751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7909fa-9a8e-4821-806d-b4b26b24820a admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.661983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7909fa-9a8e-4821-806d-b4b26b24820a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.662678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7909fa-9a8e-4821-806d-b4b26b24820a admin admin] PATH_INFO: `/v3/projects/f1d86fc653c5449e941843b8a962568e/users/55eb964a523c4abe9347127f8174238e/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.695559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7909fa-9a8e-4821-806d-b4b26b24820a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d86fc653c5449e941843b8a962568e, user_id=55eb964a523c4abe9347127f8174238e, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.701008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7909fa-9a8e-4821-806d-b4b26b24820a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.727280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 920/1817] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:47 2022] PUT /identity/v3/projects/f1d86fc653c5449e941843b8a962568e/users/55eb964a523c4abe9347127f8174238e/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:47.738974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a86637-a693-4592-8cab-13f18463fe76 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.739874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a86637-a693-4592-8cab-13f18463fe76 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.740232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a86637-a693-4592-8cab-13f18463fe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.773796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:47.787036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-58a86637-a693-4592-8cab-13f18463fe76 None None] MFA Rules not processed for user `55eb964a523c4abe9347127f8174238e`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:47.788318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-58a86637-a693-4592-8cab-13f18463fe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:47.809483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.811409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:47.824677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 898/1818] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:47.893601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 921/1819] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:28:47.898970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:47.914925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa978c-77a6-49c0-96a4-d4f564af0d8b service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:47.992641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:47.993288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:47.993528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:47.993928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:47.994568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:47.996613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.031554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 899/1820] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:47 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:48.035827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a86637-a693-4592-8cab-13f18463fe76 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:48.063198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a86637-a693-4592-8cab-13f18463fe76 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:48.168231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:48.169039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.169423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.169740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.170458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:48.172495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.197452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 922/1821] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:48 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:48.201143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:48.214879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0d3cc-6fec-4eb1-a253-6fdc283143d7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:48.221869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:48.222652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.222859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.223268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.233766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:48.240806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.267612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 900/1822] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:48.272317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:48.283747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8306458-1b98-446f-9c0a-95cf4c7d52c1 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:48.289333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:48.290024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.290317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.291268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] PATH_INFO: `/v3/projects/2c90ac1b5bd74d5bb533135c8dab3d71/users/6d1898b4fb324b889b0b4fd5528c93ab/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.309550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c90ac1b5bd74d5bb533135c8dab3d71, user_id=6d1898b4fb324b889b0b4fd5528c93ab, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:48.315122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.335007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 923/1823] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:48 2022] PUT /identity/v3/projects/2c90ac1b5bd74d5bb533135c8dab3d71/users/6d1898b4fb324b889b0b4fd5528c93ab/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:48.339147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:48.350079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65bfac-e6a6-42fe-9e8c-95a75681b1f4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:48.361754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:48.409981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecd00-bc33-44c8-9242-155e423b33db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:48.410560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecd00-bc33-44c8-9242-155e423b33db admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.410876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecd00-bc33-44c8-9242-155e423b33db admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.411175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecd00-bc33-44c8-9242-155e423b33db admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.412832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ecd00-bc33-44c8-9242-155e423b33db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:48.414866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ecd00-bc33-44c8-9242-155e423b33db admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.430302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 901/1824] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:48.431491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:48.442198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d779cc-35e8-4b46-820c-09aaf6ecbdb7 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:48.447145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:48.447808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.448093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.448400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] PATH_INFO: `/v3/projects/2c90ac1b5bd74d5bb533135c8dab3d71/users/6d1898b4fb324b889b0b4fd5528c93ab/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.450438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c90ac1b5bd74d5bb533135c8dab3d71, user_id=6d1898b4fb324b889b0b4fd5528c93ab, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:48.455744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.469124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 924/1825] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:48 2022] PUT /identity/v3/projects/2c90ac1b5bd74d5bb533135c8dab3d71/users/6d1898b4fb324b889b0b4fd5528c93ab/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:48.479639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.479859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.480139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.509474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] MFA Rules not processed for user `6d1898b4fb324b889b0b4fd5528c93ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:48.510727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:48.582116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 902/1826] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:48.595211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:48.662643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df090b-749c-401e-85dd-6a06bdf0a4eb admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:48.666322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:48.666926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.667206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.667494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.675594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:48.678717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:48.680434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.691063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 925/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:48.736930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:48.742781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:48.754856 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af75de-f5fa-49ad-b412-c0bf1f0c309e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:48.758676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:48.759318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:48.759601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:48.759877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:48.836014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:48.837505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:48.846615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 903/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:28:52.327074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:52.328765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:52.466229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc07e4-ce51-40f3-99bd-d6f654d05aa7 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:52.472517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:52.473178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:52.473618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:52.473976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] PATH_INFO: `/v3/users/c6a5ba7ad9104074a46d918616d17f9b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:52.475223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a5ba7ad9104074a46d918616d17f9b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:52.477409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:52.499130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:52.500948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:52.521172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431857c-2106-4073-8294-23ce06dec3f7 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:52.531727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:52.532544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:52.533579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:52.533948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] PATH_INFO: `/v3/users/ed192d83dde64638a74d935ff7be5c33` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:52.537192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed192d83dde64638a74d935ff7be5c33)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:52.539417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:52.565055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a5ba7ad9104074a46d918616d17f9b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.579121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a5ba7ad9104074a46d918616d17f9b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.580316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a5ba7ad9104074a46d918616d17f9b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.600686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a5ba7ad9104074a46d918616d17f9b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.624053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:52.636231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8da5943b-e9bf-49f6-9750-8d2df40f5d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a5ba7ad9104074a46d918616d17f9b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.649777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 926/1829] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:52 2022] DELETE /identity/v3/users/c6a5ba7ad9104074a46d918616d17f9b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:52.657248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:52.657873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:52.658347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:52.675094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed192d83dde64638a74d935ff7be5c33'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.686064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed192d83dde64638a74d935ff7be5c33'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.686883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed192d83dde64638a74d935ff7be5c33'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.705398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:52.707574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:52.708651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed192d83dde64638a74d935ff7be5c33'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.717687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-68c8adb4-3846-4b3d-893f-77483ad5ed0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed192d83dde64638a74d935ff7be5c33'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:52.728184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 904/1830] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:52 2022] DELETE /identity/v3/users/ed192d83dde64638a74d935ff7be5c33 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:52.732673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:52.732892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:52.733156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:52.787120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:52.788463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:52.859129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 927/1831] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:52.894832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 905/1832] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:52.907131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:52.909658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:52.911338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:52.912954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:52.927568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed182fc-a409-4330-9e72-b76079ddb774 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:52.933775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:52.934543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:52.935051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:52.935354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] PATH_INFO: `/v3/users/55eb964a523c4abe9347127f8174238e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:52.939448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55eb964a523c4abe9347127f8174238e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:52.940577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:52.945296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:53.010971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20b60-5ea7-4da9-9770-ed512b89e71f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:53.050764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55eb964a523c4abe9347127f8174238e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:53.066852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55eb964a523c4abe9347127f8174238e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:53.068793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55eb964a523c4abe9347127f8174238e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:53.097834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55eb964a523c4abe9347127f8174238e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:53.116866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9c2c310c-a45f-480a-ad2c-60fa7726aed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55eb964a523c4abe9347127f8174238e'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:53.134754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 906/1833] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:52 2022] DELETE /identity/v3/users/55eb964a523c4abe9347127f8174238e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:53.139243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100560-e919-4ecb-837e-eb4c0855d7ba None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:53.139826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100560-e919-4ecb-837e-eb4c0855d7ba None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:53.140415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100560-e919-4ecb-837e-eb4c0855d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:53.165449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-79100560-e919-4ecb-837e-eb4c0855d7ba None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:53.167426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-79100560-e919-4ecb-837e-eb4c0855d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:53.167538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:53.168106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:53.168439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:53.168713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:53.172234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:53.196395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:53.197457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:53.199739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:53.227319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 928/1834] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:53.228874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:53.233634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:53.260465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00ffa-f5b7-47db-aff6-f9ff00320590 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:53.305437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 907/1835] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:53.344296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100560-e919-4ecb-837e-eb4c0855d7ba None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:53.348421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:53.350585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:53.351568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:53.351856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:53.353905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:53.358471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100560-e919-4ecb-837e-eb4c0855d7ba None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:53.362909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:53.364041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:53.365502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:53.366126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:53.368351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:53.369875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:53.382196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:53.384090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:53.386462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 929/1836] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:53.396973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 908/1837] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:28:53.964437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:53.966002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:53.977869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53cded-1f15-4bf1-a693-7f20e2aca39e service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:53.983542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:53.983542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:53.983831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:53.984065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] PATH_INFO: `/v3/projects/c1245dbeee0141708f9531cc8195ba9e` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:53.985369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1245dbeee0141708f9531cc8195ba9e)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:53.987295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:54.068637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1245dbeee0141708f9531cc8195ba9e', 'request_id': 'req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.084070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1245dbeee0141708f9531cc8195ba9e', 'request_id': 'req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.090781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1245dbeee0141708f9531cc8195ba9e', 'request_id': 'req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.101728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:54.107039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] The token cache is being invalidate because project c1245dbeee0141708f9531cc8195ba9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:54.107039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.107900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.110321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 930/1838] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:53 2022] DELETE /identity/v3/projects/c1245dbeee0141708f9531cc8195ba9e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:54.115226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:54.134167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550c931-bed2-4e6e-9ea6-22c9361bb373 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:54.135253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:54.136916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:54.217263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:54.218040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:54.218430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:54.218817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] PATH_INFO: `/v3/users/58dbfc5cf11f44c08669381c5349b184` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:54.220071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58dbfc5cf11f44c08669381c5349b184)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:54.222376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:54.230402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ef05-6d7e-4ee1-8f9c-81aa9d4655a6 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:54.235211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:54.235850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:54.236128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:54.236770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] PATH_INFO: `/v3/projects/ffb2cf543bc64d0a8e2632355fd8033a` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:54.238620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb2cf543bc64d0a8e2632355fd8033a)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:54.241363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:54.278892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58dbfc5cf11f44c08669381c5349b184'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.290695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58dbfc5cf11f44c08669381c5349b184'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.291651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58dbfc5cf11f44c08669381c5349b184'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.302777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb2cf543bc64d0a8e2632355fd8033a', 'request_id': 'req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.320201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb2cf543bc64d0a8e2632355fd8033a', 'request_id': 'req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.322930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58dbfc5cf11f44c08669381c5349b184'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.326892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb2cf543bc64d0a8e2632355fd8033a', 'request_id': 'req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.330828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58dbfc5cf11f44c08669381c5349b184'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.338349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] The token cache is being invalidate because project ffb2cf543bc64d0a8e2632355fd8033a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:54.338642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.339203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 909/1839] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:54 2022] DELETE /identity/v3/users/58dbfc5cf11f44c08669381c5349b184 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:54.339348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.340047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:54.341441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:54.350898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 931/1840] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:54 2022] DELETE /identity/v3/projects/ffb2cf543bc64d0a8e2632355fd8033a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:28:54.354921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:54.361410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:54.389540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:54.469694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983ab5b-4e44-4e09-a34f-e3df6a5e2506 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:54.476299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:54.476998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:54.477290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:54.477570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] PATH_INFO: `/v3/users/a3a7dcd0e4b342249dc317fc1d33ba7f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:54.479210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a7dcd0e4b342249dc317fc1d33ba7f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:54.480843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac59cd-7144-4fe2-ba59-12360249c160 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:54.481259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:54.493355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:54.494549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:54.494911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:54.495258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] PATH_INFO: `/v3/projects/f1d86fc653c5449e941843b8a962568e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:54.501063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d86fc653c5449e941843b8a962568e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:54.508411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:54.541511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:54.565417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a7dcd0e4b342249dc317fc1d33ba7f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.577837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a7dcd0e4b342249dc317fc1d33ba7f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.578996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a7dcd0e4b342249dc317fc1d33ba7f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.593715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a7dcd0e4b342249dc317fc1d33ba7f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.607217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d86fc653c5449e941843b8a962568e', 'request_id': 'req-1db24581-04f0-4284-90b2-a8af1d7eb119'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.614120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d86fc653c5449e941843b8a962568e', 'request_id': 'req-1db24581-04f0-4284-90b2-a8af1d7eb119'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.620025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a7dcd0e4b342249dc317fc1d33ba7f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.623383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d86fc653c5449e941843b8a962568e', 'request_id': 'req-1db24581-04f0-4284-90b2-a8af1d7eb119'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.629677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 932/1841] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:54 2022] DELETE /identity/v3/users/a3a7dcd0e4b342249dc317fc1d33ba7f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:54.653038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] The token cache is being invalidate because project f1d86fc653c5449e941843b8a962568e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:54.653438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.654175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.658275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 910/1842] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:54 2022] DELETE /identity/v3/projects/f1d86fc653c5449e941843b8a962568e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:54.663128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:54.664676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:54.756123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47661-3524-4198-a79c-51a5a17d2164 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:54.762102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:54.762773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:54.763111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:54.763407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] PATH_INFO: `/v3/users/6d1898b4fb324b889b0b4fd5528c93ab` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:54.764810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1898b4fb324b889b0b4fd5528c93ab)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:54.767855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:54.834629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1898b4fb324b889b0b4fd5528c93ab'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.852976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:54.857476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:54.872747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1898b4fb324b889b0b4fd5528c93ab'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.873665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1898b4fb324b889b0b4fd5528c93ab'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.888673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1898b4fb324b889b0b4fd5528c93ab'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.906550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1898b4fb324b889b0b4fd5528c93ab'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:54.920906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 933/1843] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:54 2022] DELETE /identity/v3/users/6d1898b4fb324b889b0b4fd5528c93ab => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:54.975485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:54.977009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:54.991970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24581-04f0-4284-90b2-a8af1d7eb119 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.018605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:55.064319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e736a-63c5-4dbd-9184-fccc54dad7a0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.073421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.075031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.075435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.076091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] PATH_INFO: `/v3/projects/3b736a4ef32b4d40a19009d3c10e5ccc` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.077558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b736a4ef32b4d40a19009d3c10e5ccc)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.079862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.089706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.090479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.091228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.091660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] PATH_INFO: `/v3/projects/44d5f1abf1d14e56b11eb6c94e47b1c0` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.093413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d5f1abf1d14e56b11eb6c94e47b1c0)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.102181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.115427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:55.175984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b736a4ef32b4d40a19009d3c10e5ccc', 'request_id': 'req-0007b327-01bf-47c5-9664-e42e8b0d6c9c'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.188719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b736a4ef32b4d40a19009d3c10e5ccc', 'request_id': 'req-0007b327-01bf-47c5-9664-e42e8b0d6c9c'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.200876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b736a4ef32b4d40a19009d3c10e5ccc', 'request_id': 'req-0007b327-01bf-47c5-9664-e42e8b0d6c9c'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.208924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d5f1abf1d14e56b11eb6c94e47b1c0', 'request_id': 'req-3498f401-1838-4e19-af3a-30409284f509'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.220119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] The token cache is being invalidate because project 3b736a4ef32b4d40a19009d3c10e5ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:55.220555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.220794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d5f1abf1d14e56b11eb6c94e47b1c0', 'request_id': 'req-3498f401-1838-4e19-af3a-30409284f509'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.221235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0007b327-01bf-47c5-9664-e42e8b0d6c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.227476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 934/1844] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:54 2022] DELETE /identity/v3/projects/3b736a4ef32b4d40a19009d3c10e5ccc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:55.229234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.229642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.229799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.234682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d5f1abf1d14e56b11eb6c94e47b1c0', 'request_id': 'req-3498f401-1838-4e19-af3a-30409284f509'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.260188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] The token cache is being invalidate because project 44d5f1abf1d14e56b11eb6c94e47b1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:55.260524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.261416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3498f401-1838-4e19-af3a-30409284f509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.261831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:55.265932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.271506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 911/1845] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:54 2022] DELETE /identity/v3/projects/44d5f1abf1d14e56b11eb6c94e47b1c0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:55.273388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d224d7-89c2-48a5-be66-d657e0fc6115 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.273683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d224d7-89c2-48a5-be66-d657e0fc6115 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.273960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d224d7-89c2-48a5-be66-d657e0fc6115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.310462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-07d224d7-89c2-48a5-be66-d657e0fc6115 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:55.311965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-07d224d7-89c2-48a5-be66-d657e0fc6115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.410568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 935/1846] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:55.417657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.417657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.429691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd0487-21da-442f-a420-37b88b1fd21e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.453870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.454072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 912/1847] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:55.454156 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.454228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690e20-6e04-433e-a5e4-fd92eb0237dc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.454297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.454393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690e20-6e04-433e-a5e4-fd92eb0237dc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.454466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] PATH_INFO: `/v3/projects/2c90ac1b5bd74d5bb533135c8dab3d71` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.454536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690e20-6e04-433e-a5e4-fd92eb0237dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.454604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c90ac1b5bd74d5bb533135c8dab3d71)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.454604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.474891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-20690e20-6e04-433e-a5e4-fd92eb0237dc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:55.476746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-20690e20-6e04-433e-a5e4-fd92eb0237dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.487956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 913/1848] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:55.492522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752816ee-44ca-41b6-9259-8503eb8fba30 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.492668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752816ee-44ca-41b6-9259-8503eb8fba30 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.492850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752816ee-44ca-41b6-9259-8503eb8fba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.518163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-752816ee-44ca-41b6-9259-8503eb8fba30 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:55.519767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-752816ee-44ca-41b6-9259-8503eb8fba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.532395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c90ac1b5bd74d5bb533135c8dab3d71', 'request_id': 'req-01979e0c-628f-43f9-a7b9-03af864321b5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.536409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:55.542262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c90ac1b5bd74d5bb533135c8dab3d71', 'request_id': 'req-01979e0c-628f-43f9-a7b9-03af864321b5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.552614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c90ac1b5bd74d5bb533135c8dab3d71', 'request_id': 'req-01979e0c-628f-43f9-a7b9-03af864321b5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.569356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] The token cache is being invalidate because project 2c90ac1b5bd74d5bb533135c8dab3d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:55.569646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.570776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:55.572831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 936/1849] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:55 2022] DELETE /identity/v3/projects/2c90ac1b5bd74d5bb533135c8dab3d71 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:55.573590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.574921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.595364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 914/1850] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:55.596709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001436e7-8655-4933-a019-fde1f276aa32 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.597082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001436e7-8655-4933-a019-fde1f276aa32 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.597447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001436e7-8655-4933-a019-fde1f276aa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.619343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-001436e7-8655-4933-a019-fde1f276aa32 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:55.620712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-001436e7-8655-4933-a019-fde1f276aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.629475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 915/1851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:55.633130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001436e7-8655-4933-a019-fde1f276aa32 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.644011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001436e7-8655-4933-a019-fde1f276aa32 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.650964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389b7e-9c5f-4de2-ac03-41afac86feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.651541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389b7e-9c5f-4de2-ac03-41afac86feb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.651820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389b7e-9c5f-4de2-ac03-41afac86feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.652100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389b7e-9c5f-4de2-ac03-41afac86feb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.652774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389b7e-9c5f-4de2-ac03-41afac86feb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:55.652967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979e0c-628f-43f9-a7b9-03af864321b5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.653115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389b7e-9c5f-4de2-ac03-41afac86feb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.654767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389b7e-9c5f-4de2-ac03-41afac86feb9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.658457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.659106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.659391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.659689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.660472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:55.660811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.662593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.667166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 916/1852] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:55.668688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74193f-07f8-46f2-a615-46a357c70658 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.668969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74193f-07f8-46f2-a615-46a357c70658 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.669241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74193f-07f8-46f2-a615-46a357c70658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.676285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 937/1853] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:55.677830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.688489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27ccd5-4bb7-4ba3-a002-a245946b5fce admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.693935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.694539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.694775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2e74193f-07f8-46f2-a615-46a357c70658 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:55.694880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.695087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.695717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.695972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2e74193f-07f8-46f2-a615-46a357c70658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:55.697844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.705850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 917/1854] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:55.707362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74193f-07f8-46f2-a615-46a357c70658 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.727159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:55.735021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74193f-07f8-46f2-a615-46a357c70658 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.736434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 938/1855] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:55.737267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.811028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.811332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026966f-eace-46dc-ad65-6be2d53d5f43 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.812456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.813127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.813863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.815046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.817237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.818454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.818564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.818888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.819226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.820113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:28:55.820507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.822181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.838032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 939/1856] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:28:55.838032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.850677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 918/1857] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:55.851417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.852706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffacc6e-022f-4058-90d2-ef779de4e83d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.907608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:55.924719 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4e532-237b-46e1-9fa9-6f2a88e1fe72 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:55.925605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.926392 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.926936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.927203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.928515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.929770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:55.930446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:55.930565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.930792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:55.931161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:55.931842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:55.933877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:55.959185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 940/1858] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:55.961310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.970618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 919/1859] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:55.971546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:55.974368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e58440-bc86-4fca-bce7-9e49f8828420 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.043203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29548e2c-8c8a-45f9-9a2a-29def4e97f2e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.046088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.046781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.047130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.047470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.048893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.049009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.049009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.049195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.049372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.050021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.050512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.051677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.065757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 920/1860] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:56.065757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.074491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e0d62-15a2-4845-a451-0c9af4f979d0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.080949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 941/1861] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:55 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:56.080949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.083301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.083937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.084741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.085025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.085707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.087652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.088907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff864-ff38-4255-b742-28ace72b9e13 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.093509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.094166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.094450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.094723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.095373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.096990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.097515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:56.111449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 942/1862] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:56.115069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.115521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 921/1863] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:56.116896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.124070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57fcf2-606f-493f-a6ab-0dc4a7e1f321 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.127155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed43f9-95e2-4532-b151-9d9bd332c23d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.130741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.131463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.131749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.132025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.132765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.132885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.133427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.133707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.133983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] PATH_INFO: `/v3/projects/160fe0a096294039a35d70c52c6ee81a/users/2855a08f24b847cea8194f23fc468a5d/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.134669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.146703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 943/1864] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:56.147519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.156104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=160fe0a096294039a35d70c52c6ee81a, user_id=2855a08f24b847cea8194f23fc468a5d, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.157443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2e19d-517a-4a93-898f-09460c82cb1b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.158868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.162857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d099ae7-6b68-438b-8883-0c6d194e4787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.163700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099ae7-6b68-438b-8883-0c6d194e4787 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.164022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099ae7-6b68-438b-8883-0c6d194e4787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.164430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099ae7-6b68-438b-8883-0c6d194e4787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.165334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d099ae7-6b68-438b-8883-0c6d194e4787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.167063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d099ae7-6b68-438b-8883-0c6d194e4787 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.171592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 922/1865] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:56 2022] PUT /identity/v3/projects/160fe0a096294039a35d70c52c6ee81a/users/2855a08f24b847cea8194f23fc468a5d/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:56.172637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.181127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 944/1866] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:56.181127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bfdb-ede1-470b-9209-1af5ae01d1bc None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.181127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bfdb-ede1-470b-9209-1af5ae01d1bc None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.181127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7bfdb-ede1-470b-9209-1af5ae01d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.200101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d6d7bfdb-ede1-470b-9209-1af5ae01d1bc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:56.201454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d6d7bfdb-ede1-470b-9209-1af5ae01d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:56.237409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f692332-15e3-4689-ab80-8177d88567dc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.243343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.243952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.244233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.244536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.245177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.246765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.257508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 923/1867] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:56.258155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.261899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 945/1868] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:56.262655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7bfdb-ede1-470b-9209-1af5ae01d1bc None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.267732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba710-73c1-46fa-87bc-6156024f2aac admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.272238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7bfdb-ede1-470b-9209-1af5ae01d1bc None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.272927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.273664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.274049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.274319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.274956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.276731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.277015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.277696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.278002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.278314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] PATH_INFO: `/v3/projects/d9a9ac976e4044a389231eb1c6c46aea/users/4db19cc8219f4fa4b7dc5cda2790697c/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.290043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 924/1869] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:56.290043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.291741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:56.296870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a9ac976e4044a389231eb1c6c46aea, user_id=4db19cc8219f4fa4b7dc5cda2790697c, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.300272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.315958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 946/1870] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:56 2022] PUT /identity/v3/projects/d9a9ac976e4044a389231eb1c6c46aea/users/4db19cc8219f4fa4b7dc5cda2790697c/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:56.317059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.334478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:56.373434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9e72-99c1-4bc2-839a-26cce0eb5493 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.405445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c280-6325-48f8-b0e9-6fa243c061aa admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.412614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8184c6-ac17-4113-b1ce-7f1c30c8e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.413401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8184c6-ac17-4113-b1ce-7f1c30c8e204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.413767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8184c6-ac17-4113-b1ce-7f1c30c8e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.414485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8184c6-ac17-4113-b1ce-7f1c30c8e204 admin admin] PATH_INFO: `/v3/projects/fc2e51f918a74eacbe788fa6f9c63365/users/0cd084259d0747b49bb7d069dc05f256/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.426697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc772231-db02-4601-a5ae-09ac1437512a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.427922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772231-db02-4601-a5ae-09ac1437512a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.428293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772231-db02-4601-a5ae-09ac1437512a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.428654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772231-db02-4601-a5ae-09ac1437512a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.432360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8184c6-ac17-4113-b1ce-7f1c30c8e204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2e51f918a74eacbe788fa6f9c63365, user_id=0cd084259d0747b49bb7d069dc05f256, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.435172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8184c6-ac17-4113-b1ce-7f1c30c8e204 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.440105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc772231-db02-4601-a5ae-09ac1437512a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.441811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc772231-db02-4601-a5ae-09ac1437512a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.452980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 947/1871] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:56 2022] PUT /identity/v3/projects/fc2e51f918a74eacbe788fa6f9c63365/users/0cd084259d0747b49bb7d069dc05f256/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:56.454363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f8b4e-2a2b-40cb-96d0-b855d4be7ce5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.454699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f8b4e-2a2b-40cb-96d0-b855d4be7ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.455116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f8b4e-2a2b-40cb-96d0-b855d4be7ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.476261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 925/1872] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:56.478965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc054-6a65-490d-b8e2-c995157d4ae2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.480657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc054-6a65-490d-b8e2-c995157d4ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.480943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc054-6a65-490d-b8e2-c995157d4ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.496825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1e4f8b4e-2a2b-40cb-96d0-b855d4be7ce5 None None] MFA Rules not processed for user `4db19cc8219f4fa4b7dc5cda2790697c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:56.498086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1e4f8b4e-2a2b-40cb-96d0-b855d4be7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:56.509808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:56.521611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8cbcc054-6a65-490d-b8e2-c995157d4ae2 None None] MFA Rules not processed for user `0cd084259d0747b49bb7d069dc05f256`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:56.524115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8cbcc054-6a65-490d-b8e2-c995157d4ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:56.595843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 948/1873] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:56.600660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f8b4e-2a2b-40cb-96d0-b855d4be7ce5 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.612858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 926/1874] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:56.613986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcc054-6a65-490d-b8e2-c995157d4ae2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.745453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcc054-6a65-490d-b8e2-c995157d4ae2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.748157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f8b4e-2a2b-40cb-96d0-b855d4be7ce5 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.751556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.752645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.752645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.752841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.753775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.754357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.755602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.756029 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.756426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.757354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.757497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.760138 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.796390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 927/1875] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:56.800952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.813501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 949/1876] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:28:56.817829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.832486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:56.912077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e354e-7ace-42bf-9a9c-00d59a5526bb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.917772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f2b2-4d95-45bc-a69f-8a4752b217a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.918389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f2b2-4d95-45bc-a69f-8a4752b217a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.918806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f2b2-4d95-45bc-a69f-8a4752b217a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.919293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f2b2-4d95-45bc-a69f-8a4752b217a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.919922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f2b2-4d95-45bc-a69f-8a4752b217a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.922265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f2b2-4d95-45bc-a69f-8a4752b217a4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.943873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05577-bcf3-445f-b76b-54d4a8a07872 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.949332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf93fa-da57-4ff9-910a-fe1eaf583db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.950391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf93fa-da57-4ff9-910a-fe1eaf583db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.950895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf93fa-da57-4ff9-910a-fe1eaf583db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.950997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 928/1877] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:56.951388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf93fa-da57-4ff9-910a-fe1eaf583db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.952184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf93fa-da57-4ff9-910a-fe1eaf583db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.952392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabf68c-54ff-4e50-84fb-2b356c449e57 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.952718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabf68c-54ff-4e50-84fb-2b356c449e57 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.952996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabf68c-54ff-4e50-84fb-2b356c449e57 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.954515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 929/1878] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:28:56.955196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabf68c-54ff-4e50-84fb-2b356c449e57 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:56.955425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf93fa-da57-4ff9-910a-fe1eaf583db6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:56.974277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabf68c-54ff-4e50-84fb-2b356c449e57 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:56.979942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:56.980589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.980870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.981307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.982123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:56.983866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 950/1879] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:28:56.985552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb795a1-a609-412e-8da0-a007267a01e7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:56.985552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb795a1-a609-412e-8da0-a007267a01e7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:56.985773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb795a1-a609-412e-8da0-a007267a01e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:56.987710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.000253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 930/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:57.001131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.010633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:57.015547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa78a-7f17-4458-906f-6a7152bb039f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.022068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.022377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.022734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.023082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.023891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.025475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.029664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0cb795a1-a609-412e-8da0-a007267a01e7 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:57.032288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0cb795a1-a609-412e-8da0-a007267a01e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:57.039878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 931/1881] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:57.043872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.056535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb483-bf8e-4ec8-821a-159815d736bf admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.062427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.063607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.063968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.064316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] PATH_INFO: `/v3/projects/66011263d95f499283ae7cfbc8638b7e/users/ff9bf620e30841f4989105ab326103a4/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.085220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66011263d95f499283ae7cfbc8638b7e, user_id=ff9bf620e30841f4989105ab326103a4, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.088082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.102665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 932/1882] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:57 2022] PUT /identity/v3/projects/66011263d95f499283ae7cfbc8638b7e/users/ff9bf620e30841f4989105ab326103a4/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:57.104004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.140997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 951/1883] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:57.142187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb795a1-a609-412e-8da0-a007267a01e7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.159747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb795a1-a609-412e-8da0-a007267a01e7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.212540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf77e8-843c-4036-a11b-ef5157883ed5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.224829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.225802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.226222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.226995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.230303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.232483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.251494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 933/1884] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:57.253405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.257604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:57.273671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.274451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.274735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.274990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.275663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.277444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.292149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 952/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:57.293014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.319861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c4d7d-151d-4c5b-9e55-a1854ad86d09 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.329696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.330761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.331168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.331617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] PATH_INFO: `/v3/projects/3a5abb0fb41b4bb89297a4f9a3bdd6bc/users/241f411880d54c2f9961cfb55cbef343/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.355551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5abb0fb41b4bb89297a4f9a3bdd6bc, user_id=241f411880d54c2f9961cfb55cbef343, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.359056 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.381485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 953/1886] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:57 2022] PUT /identity/v3/projects/3a5abb0fb41b4bb89297a4f9a3bdd6bc/users/241f411880d54c2f9961cfb55cbef343/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:57.382578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.388002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a055c6-85f3-45f4-8ffc-0a73bbe8aa80 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.396867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:57.474218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ac62-dbd9-46c6-85e0-660c1167cd18 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.481640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159399b2-b680-4bda-b9b5-8c4116bfc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.481640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159399b2-b680-4bda-b9b5-8c4116bfc762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.481640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159399b2-b680-4bda-b9b5-8c4116bfc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.482464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159399b2-b680-4bda-b9b5-8c4116bfc762 admin admin] PATH_INFO: `/v3/projects/66011263d95f499283ae7cfbc8638b7e/users/ff9bf620e30841f4989105ab326103a4/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.483714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:57.484344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159399b2-b680-4bda-b9b5-8c4116bfc762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66011263d95f499283ae7cfbc8638b7e, user_id=ff9bf620e30841f4989105ab326103a4, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.488687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159399b2-b680-4bda-b9b5-8c4116bfc762 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.499526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c043f2-cc25-4bb8-a573-700c9cb9fdf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.500660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c043f2-cc25-4bb8-a573-700c9cb9fdf7 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.501004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c043f2-cc25-4bb8-a573-700c9cb9fdf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.501276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c043f2-cc25-4bb8-a573-700c9cb9fdf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.504441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 954/1887] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:57 2022] PUT /identity/v3/projects/66011263d95f499283ae7cfbc8638b7e/users/ff9bf620e30841f4989105ab326103a4/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:57.506280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5d4d1-649c-42d1-97a0-45b9c5ee5eb8 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.506666 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5d4d1-649c-42d1-97a0-45b9c5ee5eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.507578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5d4d1-649c-42d1-97a0-45b9c5ee5eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.528458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c043f2-cc25-4bb8-a573-700c9cb9fdf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.530176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c043f2-cc25-4bb8-a573-700c9cb9fdf7 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.542152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 934/1888] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:57.543490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a0c18-0074-45c2-9017-bc738c24a06f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.543809 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a0c18-0074-45c2-9017-bc738c24a06f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.544157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a0c18-0074-45c2-9017-bc738c24a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.548168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6cf5d4d1-649c-42d1-97a0-45b9c5ee5eb8 None None] MFA Rules not processed for user `241f411880d54c2f9961cfb55cbef343`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:57.549514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6cf5d4d1-649c-42d1-97a0-45b9c5ee5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:57.594161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fd4a0c18-0074-45c2-9017-bc738c24a06f None None] MFA Rules not processed for user `ff9bf620e30841f4989105ab326103a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:57.595697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fd4a0c18-0074-45c2-9017-bc738c24a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:57.643413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 955/1889] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:57.645141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.645434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.645743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.679099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 935/1890] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:57.679956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a0c18-0074-45c2-9017-bc738c24a06f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.680349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] MFA Rules not processed for user `2855a08f24b847cea8194f23fc468a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:57.681725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:57.756830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 956/1891] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:57.758044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.759898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:57.772262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a0c18-0074-45c2-9017-bc738c24a06f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.778965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.779680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.780190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.780687 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.781421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.783471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.788336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:57.824656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 936/1892] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:57 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:57.825841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:57.853212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c931-cb65-442b-a2fa-c96b7094b9ed None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.918077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0dd64-68d2-40ce-a860-c0d086145c80 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:57.924052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.924726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.925010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.925117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:57.925291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.925683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:57.926053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:57.926155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:57.926244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:57.928722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:57.934699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:57.980379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 937/1893] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:28:57 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:57.981449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.017824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.019461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.029588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 957/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:58.030408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.041911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148df897-b50e-4109-ba60-37ca55654c5b service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.107153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e8fb-3e07-4e25-9b4c-6c0e42d8cf9f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.118366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.119116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.119401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.119682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.132890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.132890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.143987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.145297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.145297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.145297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.146135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.148963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.156879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 938/1895] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:57 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:58.160944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.181113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 958/1896] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:28:58 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:28:58.182462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.189203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914c0d7-ff72-4414-96c7-3934c8f81519 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.198901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.198901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.198901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.199176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324088-1593-42c1-b1a3-4f3074aae5a4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.199266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.199266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.199266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.204929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.205652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.206408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.206748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.207650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.209681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.211614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 939/1897] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:58.212542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.219623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:58.223266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3d04-643c-4deb-beb1-3abcc6f09b4e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.229845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 959/1898] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:28:58.232066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.232231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.232862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.233174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.233481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] PATH_INFO: `/v3/users/0cd084259d0747b49bb7d069dc05f256` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.234763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd084259d0747b49bb7d069dc05f256)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.236966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.246430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d01f-592c-433b-b90b-547c6b7b12f3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.252146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.252852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.253130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.253723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] PATH_INFO: `/v3/projects/cad55583a89c486dad32499cae637e99/users/923e28ec56a8405b8735bcc52bd3ef0d/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.270003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad55583a89c486dad32499cae637e99, user_id=923e28ec56a8405b8735bcc52bd3ef0d, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.272836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.286597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 960/1899] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:58 2022] PUT /identity/v3/projects/cad55583a89c486dad32499cae637e99/users/923e28ec56a8405b8735bcc52bd3ef0d/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:58.287693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.290717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd084259d0747b49bb7d069dc05f256'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:58.298434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd084259d0747b49bb7d069dc05f256'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:58.299191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd084259d0747b49bb7d069dc05f256'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:58.311822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd084259d0747b49bb7d069dc05f256'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:58.320725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd084259d0747b49bb7d069dc05f256'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:58.327460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 940/1900] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:58 2022] DELETE /identity/v3/users/0cd084259d0747b49bb7d069dc05f256 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:58.328303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.329649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:58.355633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a200d-b8a5-4f1f-b3bc-949d8383fb50 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.374807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:58.403847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7a58-c7a8-455b-8e47-4fdfec2926a8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.410758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a9e70-bf37-4391-a47d-5069deaacb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.412801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a9e70-bf37-4391-a47d-5069deaacb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.413098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a9e70-bf37-4391-a47d-5069deaacb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.413379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a9e70-bf37-4391-a47d-5069deaacb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.414079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a9e70-bf37-4391-a47d-5069deaacb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.415921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a9e70-bf37-4391-a47d-5069deaacb74 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.422464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.423583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.423988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.424296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] PATH_INFO: `/v3/projects/2463eedcbdfe46df91f4f5e8b120af4c/users/68673aa9407941f5a1ae554eace44a1a/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.432178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 941/1901] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:58.432178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.432178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.432178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.442766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2463eedcbdfe46df91f4f5e8b120af4c, user_id=68673aa9407941f5a1ae554eace44a1a, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.445597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.461155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 961/1902] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:58 2022] PUT /identity/v3/projects/2463eedcbdfe46df91f4f5e8b120af4c/users/68673aa9407941f5a1ae554eace44a1a/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:58.465489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.469867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:58.471182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:58.554303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa72c38-2463-49fb-b388-5cfecd68beb3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.560757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.561507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.561860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.562203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] PATH_INFO: `/v3/projects/cad55583a89c486dad32499cae637e99/users/923e28ec56a8405b8735bcc52bd3ef0d/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.564242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad55583a89c486dad32499cae637e99, user_id=923e28ec56a8405b8735bcc52bd3ef0d, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.567313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.576219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 942/1903] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:58.577743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.579102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:58.580033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:58.587540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 962/1904] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:58 2022] PUT /identity/v3/projects/cad55583a89c486dad32499cae637e99/users/923e28ec56a8405b8735bcc52bd3ef0d/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:58.589988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.593201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:58.595079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad387a1-ec7b-410a-afed-3973890d5e7a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.670626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b8e7-5194-41b7-8fa7-21b9435ae4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.671572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b8e7-5194-41b7-8fa7-21b9435ae4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.671953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b8e7-5194-41b7-8fa7-21b9435ae4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.673064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b8e7-5194-41b7-8fa7-21b9435ae4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.674018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b8e7-5194-41b7-8fa7-21b9435ae4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.677084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b8e7-5194-41b7-8fa7-21b9435ae4bf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.677982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c4785-13fc-4295-bb32-c600c9ae7da8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.682807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.683431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.683874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.684159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.695407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.697107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.708860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 943/1905] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:28:58.710970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 963/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:58.712124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.713576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.714026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.714396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.723070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715389d7-6cb6-4dc3-b471-333880cf8ecc service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.730274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.731315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.731768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.732186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] PATH_INFO: `/v3/projects/2463eedcbdfe46df91f4f5e8b120af4c/users/68673aa9407941f5a1ae554eace44a1a/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.735191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2463eedcbdfe46df91f4f5e8b120af4c, user_id=68673aa9407941f5a1ae554eace44a1a, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.738521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.759435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 964/1907] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:28:58 2022] PUT /identity/v3/projects/2463eedcbdfe46df91f4f5e8b120af4c/users/68673aa9407941f5a1ae554eace44a1a/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:58.764144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] MFA Rules not processed for user `923e28ec56a8405b8735bcc52bd3ef0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:58.765968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:58.853214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:58.872314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 944/1908] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:28:58.885683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:58.887416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:58.961062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b8ea-650a-434b-973c-acbe8b9376e0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:58.967017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:58.968027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:58.968518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:58.968800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:58.981218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:58.983199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:58.997236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 965/1909] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:28:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:28:59.094233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:59.095763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:28:59.251386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61f20-6d7b-49fd-bbaf-ab3a1ecc8777 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:59.265775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:59.266047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:59.266335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:59.266614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] PATH_INFO: `/v3/projects/fc2e51f918a74eacbe788fa6f9c63365` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:59.274673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2e51f918a74eacbe788fa6f9c63365)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:59.284996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:59.422876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2e51f918a74eacbe788fa6f9c63365', 'request_id': 'req-28654b4a-c4d2-4c3d-b398-d28c75d940f0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.433997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2e51f918a74eacbe788fa6f9c63365', 'request_id': 'req-28654b4a-c4d2-4c3d-b398-d28c75d940f0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.448395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2e51f918a74eacbe788fa6f9c63365', 'request_id': 'req-28654b4a-c4d2-4c3d-b398-d28c75d940f0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.478931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] The token cache is being invalidate because project fc2e51f918a74eacbe788fa6f9c63365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:28:59.479364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.480170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-28654b4a-c4d2-4c3d-b398-d28c75d940f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.482019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 945/1910] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:28:59 2022] DELETE /identity/v3/projects/fc2e51f918a74eacbe788fa6f9c63365 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:59.487186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:28:59.509481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d9b5d-e3c5-4971-aa12-9f1e47bd48b4 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:28:59.684867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:28:59.689908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:59.690007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:59.690381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] PATH_INFO: `/v3/users/ff9bf620e30841f4989105ab326103a4` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:59.694862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9bf620e30841f4989105ab326103a4)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:28:59.697548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:28:59.768746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:28:59.788732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9bf620e30841f4989105ab326103a4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.804758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9bf620e30841f4989105ab326103a4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.807636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9bf620e30841f4989105ab326103a4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.838607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9bf620e30841f4989105ab326103a4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.868806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba5bad-8b7e-4c5e-ad27-cd0bc1567c29 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:28:59.869560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba5bad-8b7e-4c5e-ad27-cd0bc1567c29 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:28:59.870214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba5bad-8b7e-4c5e-ad27-cd0bc1567c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:28:59.878821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9bf620e30841f4989105ab326103a4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:28:59.887140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 966/1911] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:28:59 2022] DELETE /identity/v3/users/ff9bf620e30841f4989105ab326103a4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:28:59.948961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-29ba5bad-8b7e-4c5e-ad27-cd0bc1567c29 None None] MFA Rules not processed for user `68673aa9407941f5a1ae554eace44a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:28:59.950397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-29ba5bad-8b7e-4c5e-ad27-cd0bc1567c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.071651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:00.071651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.075224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 946/1912] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:28:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:00.087593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.088730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.088730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.112972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] MFA Rules not processed for user `2855a08f24b847cea8194f23fc468a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:00.114726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.119244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:00.154342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb73e-83cf-4334-846a-306db058a188 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:00.159065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:00.160421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.160642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.161075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.163255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.186541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 947/1913] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:00.199575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:00.216722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.243494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:00.245318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:00.256134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 967/1914] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:00.295105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:00.296553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.321983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51b4e-aea2-4bfd-89c1-74760d9ecefd None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:00.329890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94757cb7-2aed-4a73-b5f7-922553bef7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:00.330561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757cb7-2aed-4a73-b5f7-922553bef7e4 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.330840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757cb7-2aed-4a73-b5f7-922553bef7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.331153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757cb7-2aed-4a73-b5f7-922553bef7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.333377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-94757cb7-2aed-4a73-b5f7-922553bef7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.346246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94757cb7-2aed-4a73-b5f7-922553bef7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:00.348042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94757cb7-2aed-4a73-b5f7-922553bef7e4 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:00.359873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 948/1915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:00.376767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8405-569e-4231-ad3a-9e281167684f service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:00.384358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:00.385005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.385334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.385611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] PATH_INFO: `/v3/projects/66011263d95f499283ae7cfbc8638b7e` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.386801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66011263d95f499283ae7cfbc8638b7e)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:00.388796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:00.398435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:00.450730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66011263d95f499283ae7cfbc8638b7e', 'request_id': 'req-f9766df1-81f8-437a-9ef4-9ec3edc3415a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:00.460228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66011263d95f499283ae7cfbc8638b7e', 'request_id': 'req-f9766df1-81f8-437a-9ef4-9ec3edc3415a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:00.466633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66011263d95f499283ae7cfbc8638b7e', 'request_id': 'req-f9766df1-81f8-437a-9ef4-9ec3edc3415a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:00.480500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] The token cache is being invalidate because project 66011263d95f499283ae7cfbc8638b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:00.480800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:00.481471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f9766df1-81f8-437a-9ef4-9ec3edc3415a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:00.483471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 968/1916] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:00 2022] DELETE /identity/v3/projects/66011263d95f499283ae7cfbc8638b7e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:00.488049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3ca8-278e-44fb-a2e4-c9167d39e5c7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.488269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3ca8-278e-44fb-a2e4-c9167d39e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.488578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3ca8-278e-44fb-a2e4-c9167d39e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.515066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d36d3ca8-278e-44fb-a2e4-c9167d39e5c7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:00.517373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d36d3ca8-278e-44fb-a2e4-c9167d39e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.623522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 949/1917] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:00.625439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc86d7-e86a-4ac3-bbf9-1c7399b1f84c None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.625750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc86d7-e86a-4ac3-bbf9-1c7399b1f84c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.625949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc86d7-e86a-4ac3-bbf9-1c7399b1f84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.665612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-00cc86d7-e86a-4ac3-bbf9-1c7399b1f84c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:00.675714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-00cc86d7-e86a-4ac3-bbf9-1c7399b1f84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:00.689420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 969/1918] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:00.694770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3ca8-278e-44fb-a2e4-c9167d39e5c7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:00.708541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3ca8-278e-44fb-a2e4-c9167d39e5c7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:00.713455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:00.714437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.714911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.715487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.716356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:00.716831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:00.718637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:00.732469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 950/1919] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:00.737846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc86d7-e86a-4ac3-bbf9-1c7399b1f84c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:00.747011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc86d7-e86a-4ac3-bbf9-1c7399b1f84c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:00.752443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:00.753060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.753398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.753618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.755387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:00.757017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:00.788258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 970/1920] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:00 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:00.792101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:00.804942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90451da9-347b-442c-bc94-e8968fd3455d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:00.837408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:00.885622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:00.886310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.886593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.886868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.887518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:00.889563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:00.916323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 951/1921] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:00 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:00.923609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:00.949962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f764d-54c2-4b72-8aae-6f1cef449b36 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:00.969043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:00.969697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:00.969985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:00.970266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:00.971226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:00.973188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.000604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 971/1922] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:01.004565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.018198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec4f0-5c1e-4b53-a153-494721fad401 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.032119 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ab08d-7d3e-469d-b1ef-6e3cc353c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.033169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ab08d-7d3e-469d-b1ef-6e3cc353c01b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.033430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ab08d-7d3e-469d-b1ef-6e3cc353c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.034380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ab08d-7d3e-469d-b1ef-6e3cc353c01b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.035783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ab08d-7d3e-469d-b1ef-6e3cc353c01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.043495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ab08d-7d3e-469d-b1ef-6e3cc353c01b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.084562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.084721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 952/1923] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:01.095150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f5d65-2753-48be-8af3-864bc1938548 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.102874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.103811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.104168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.104496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] PATH_INFO: `/v3/projects/7cb5eaf30ab7405f8e01e165dbd0a7c9/users/930833ea5b7246a3aa06003ec319901c/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.124435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb5eaf30ab7405f8e01e165dbd0a7c9, user_id=930833ea5b7246a3aa06003ec319901c, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.127507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.169252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 972/1924] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:01 2022] PUT /identity/v3/projects/7cb5eaf30ab7405f8e01e165dbd0a7c9/users/930833ea5b7246a3aa06003ec319901c/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:01.185956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde055d-422d-44a4-b134-157c8faa6776 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.186286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde055d-422d-44a4-b134-157c8faa6776 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.186570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde055d-422d-44a4-b134-157c8faa6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.226684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fbde055d-422d-44a4-b134-157c8faa6776 None None] MFA Rules not processed for user `930833ea5b7246a3aa06003ec319901c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:01.228466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fbde055d-422d-44a4-b134-157c8faa6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:01.347502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 953/1925] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:01.349002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.429407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b237f-874d-42cb-8051-bf8fe4eab8d8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.434783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.435704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.435908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.436186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.437433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.438850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.480022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 973/1926] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:01 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:01.483940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde055d-422d-44a4-b134-157c8faa6776 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.496244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde055d-422d-44a4-b134-157c8faa6776 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.618513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.619280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.619758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.620390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.620767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.623086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.668724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 954/1927] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:01 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:01.673646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.695813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef50f-a96a-41d3-a828-45a6759434cf admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.702961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.703748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.704089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.704414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.705260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.707193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.718444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 974/1928] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:01.722645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.732961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902b8b-985b-4267-8bc0-46a6d703dcf2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.737931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.738619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.738897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.740163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] PATH_INFO: `/v3/projects/500ca1903cef4bcd825cf82d351d583c/users/b2f50c15406e4d6bb1a8c44f9a80bd67/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.756595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500ca1903cef4bcd825cf82d351d583c, user_id=b2f50c15406e4d6bb1a8c44f9a80bd67, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.759433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.768556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:01.773360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 955/1929] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:01 2022] PUT /identity/v3/projects/500ca1903cef4bcd825cf82d351d583c/users/b2f50c15406e4d6bb1a8c44f9a80bd67/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:01.777437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.788503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d7fc3-d98c-45bf-81e4-4e97a96e4301 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.792207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:01.854789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9640ab-370c-4d85-a78e-c90c63949b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.855628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9640ab-370c-4d85-a78e-c90c63949b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.856163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9640ab-370c-4d85-a78e-c90c63949b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.856610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9640ab-370c-4d85-a78e-c90c63949b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.857401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9640ab-370c-4d85-a78e-c90c63949b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.859329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9640ab-370c-4d85-a78e-c90c63949b1f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.870626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 975/1930] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:01.875094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:01.885853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cef8aa-25e9-4c73-a578-5e946d63e0b5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:01.890364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:01.891005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.891281 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.891550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] PATH_INFO: `/v3/projects/500ca1903cef4bcd825cf82d351d583c/users/b2f50c15406e4d6bb1a8c44f9a80bd67/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.893443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500ca1903cef4bcd825cf82d351d583c, user_id=b2f50c15406e4d6bb1a8c44f9a80bd67, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:01.896080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:01.906053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 956/1931] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:01 2022] PUT /identity/v3/projects/500ca1903cef4bcd825cf82d351d583c/users/b2f50c15406e4d6bb1a8c44f9a80bd67/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:01.917604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:01.917931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:01.918213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:01.946972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] MFA Rules not processed for user `b2f50c15406e4d6bb1a8c44f9a80bd67`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:01.948230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:02.020787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 976/1932] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:02.033568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:02.035220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:02.111588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832db7-0c2f-48ed-9c5c-fc6c0e104108 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:02.115790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:02.116570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:02.116848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:02.117120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:02.126511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:02.127929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:02.137251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 957/1933] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:02.218431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:02.220344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:02.229423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:02.237926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2a6ef-025c-4abd-8b99-5e5d6d229b3b service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:02.242202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916d9ba-0070-46a1-bd0f-32a869072c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:02.242918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d9ba-0070-46a1-bd0f-32a869072c8d service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:02.243271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d9ba-0070-46a1-bd0f-32a869072c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:02.243629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d9ba-0070-46a1-bd0f-32a869072c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:02.301360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b255e-e6a1-4a29-a028-9b800002db96 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:02.306776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:02.307434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:02.307712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:02.307987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] PATH_INFO: `/v3/users/0941eb53a46b443fb8737e9964ab48d7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:02.308894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916d9ba-0070-46a1-bd0f-32a869072c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:02.309181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0941eb53a46b443fb8737e9964ab48d7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:02.310643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916d9ba-0070-46a1-bd0f-32a869072c8d service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:02.311143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:02.320820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 958/1934] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:02.350004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:02.365529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0941eb53a46b443fb8737e9964ab48d7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0941eb53a46b443fb8737e9964ab48d7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.378957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0941eb53a46b443fb8737e9964ab48d7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.385667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0941eb53a46b443fb8737e9964ab48d7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.398168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0941eb53a46b443fb8737e9964ab48d7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.404249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 977/1935] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:02 2022] DELETE /identity/v3/users/0941eb53a46b443fb8737e9964ab48d7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:02.408975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:02.409451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:02.409542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:02.429827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:02.431060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:02.527510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 959/1936] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:02.539752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:02.541304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:02.611795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b818-3f33-4adf-9335-ec27fb8f37d4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:02.616899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11129-0251-48ae-930d-dd268dec666e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:02.617665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11129-0251-48ae-930d-dd268dec666e service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:02.618102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11129-0251-48ae-930d-dd268dec666e service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:02.618352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11129-0251-48ae-930d-dd268dec666e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:02.630033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11129-0251-48ae-930d-dd268dec666e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:02.631756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11129-0251-48ae-930d-dd268dec666e service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:02.669166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:02.672264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:02.679319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 978/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:02.695395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5032e-3e18-476b-b12c-537e2d14f8a9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:02.703913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:02.705094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:02.706115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:02.706653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] PATH_INFO: `/v3/users/930833ea5b7246a3aa06003ec319901c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:02.708833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] RBAC: Authorizing `identity:delete_user(user_id=930833ea5b7246a3aa06003ec319901c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:02.711567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:02.760796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:02.809748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930833ea5b7246a3aa06003ec319901c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.822440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930833ea5b7246a3aa06003ec319901c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.823242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930833ea5b7246a3aa06003ec319901c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.844319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930833ea5b7246a3aa06003ec319901c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.859689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930833ea5b7246a3aa06003ec319901c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:02.878479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:02.879003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:02.879797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:02.891048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 960/1938] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:02 2022] DELETE /identity/v3/users/930833ea5b7246a3aa06003ec319901c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:02.928185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:02.929684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:03.049796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 979/1939] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:03.123141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:03.125443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:03.280245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227629-a334-47d0-bbe4-8c9e4ddb141f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:03.293434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:03.294155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:03.294471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:03.294784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:03.320373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:03.321914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:03.352243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 961/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:03.621040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:03.622486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:03.637266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf53ce-2a80-471d-a18d-cf36be7ec319 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:03.642135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:03.642863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:03.643296 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:03.643662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] PATH_INFO: `/v3/projects/ca1e2f607845423f8f0aab1ba9b36578` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:03.644915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1e2f607845423f8f0aab1ba9b36578)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:03.647017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:03.700424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:03.703991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1e2f607845423f8f0aab1ba9b36578', 'request_id': 'req-086cd6f5-5711-4857-b1d0-4e78901f8180'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:03.716214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1e2f607845423f8f0aab1ba9b36578', 'request_id': 'req-086cd6f5-5711-4857-b1d0-4e78901f8180'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:03.727573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1e2f607845423f8f0aab1ba9b36578', 'request_id': 'req-086cd6f5-5711-4857-b1d0-4e78901f8180'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:03.743324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] The token cache is being invalidate because project ca1e2f607845423f8f0aab1ba9b36578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:03.743702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:03.745045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:03.746888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 980/1941] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:03 2022] DELETE /identity/v3/projects/ca1e2f607845423f8f0aab1ba9b36578 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:03.751256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:03.765125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf6b75-9b8c-4cfd-90a3-074526c3430d service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:03.883204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:03.884673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:03.885125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:03.885585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] PATH_INFO: `/v3/users/b04ef0bcf1994d2aa36212977d4e78c9` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:03.888055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04ef0bcf1994d2aa36212977d4e78c9)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:03.890764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:03.951157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:03.953986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04ef0bcf1994d2aa36212977d4e78c9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:03.980612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04ef0bcf1994d2aa36212977d4e78c9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:03.982127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04ef0bcf1994d2aa36212977d4e78c9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.000104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04ef0bcf1994d2aa36212977d4e78c9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.007969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04ef0bcf1994d2aa36212977d4e78c9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.014702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 962/1942] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:03 2022] DELETE /identity/v3/users/b04ef0bcf1994d2aa36212977d4e78c9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:04.418601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:04.425321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:04.444044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd6f5-5711-4857-b1d0-4e78901f8180 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:04.522329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:04.522961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:04.523240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:04.524538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] PATH_INFO: `/v3/projects/7cb5eaf30ab7405f8e01e165dbd0a7c9` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:04.525677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb5eaf30ab7405f8e01e165dbd0a7c9)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:04.527579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:04.577583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:04.579210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:04.600758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7175b-2901-4841-8083-e21da91e0c16 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:04.624832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb5eaf30ab7405f8e01e165dbd0a7c9', 'request_id': 'req-4ae1380d-225f-4a29-8d13-7e3de74b225b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.638163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb5eaf30ab7405f8e01e165dbd0a7c9', 'request_id': 'req-4ae1380d-225f-4a29-8d13-7e3de74b225b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.646197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb5eaf30ab7405f8e01e165dbd0a7c9', 'request_id': 'req-4ae1380d-225f-4a29-8d13-7e3de74b225b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.660379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] The token cache is being invalidate because project 7cb5eaf30ab7405f8e01e165dbd0a7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:04.660576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.661857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.663362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 981/1943] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:04 2022] DELETE /identity/v3/projects/7cb5eaf30ab7405f8e01e165dbd0a7c9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:04.667062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:04.668521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:04.672727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:04.673365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:04.673645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:04.674047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] PATH_INFO: `/v3/projects/27600aebf352496da8a10ba10cab9ca1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:04.675170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27600aebf352496da8a10ba10cab9ca1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:04.678000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:04.684413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1380d-225f-4a29-8d13-7e3de74b225b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:04.690769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:04.692911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:04.693793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:04.694576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] PATH_INFO: `/v3/users/b2f50c15406e4d6bb1a8c44f9a80bd67` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:04.697060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f50c15406e4d6bb1a8c44f9a80bd67)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:04.702132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:04.743908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27600aebf352496da8a10ba10cab9ca1', 'request_id': 'req-761d64a1-f40e-48f5-be43-7a8ffefcce17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.755121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27600aebf352496da8a10ba10cab9ca1', 'request_id': 'req-761d64a1-f40e-48f5-be43-7a8ffefcce17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.759359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f50c15406e4d6bb1a8c44f9a80bd67'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.762308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27600aebf352496da8a10ba10cab9ca1', 'request_id': 'req-761d64a1-f40e-48f5-be43-7a8ffefcce17'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.768825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f50c15406e4d6bb1a8c44f9a80bd67'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.769540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f50c15406e4d6bb1a8c44f9a80bd67'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.774735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=19,keystone:SELECT=78,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:04.777957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f50c15406e4d6bb1a8c44f9a80bd67'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.778659 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] The token cache is being invalidate because project 27600aebf352496da8a10ba10cab9ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:04.779026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.779661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-761d64a1-f40e-48f5-be43-7a8ffefcce17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.782233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 963/1944] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:04 2022] DELETE /identity/v3/projects/27600aebf352496da8a10ba10cab9ca1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:04.787553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62284a3-78ac-439b-a21e-af3a72cd70ca None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:04.788018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62284a3-78ac-439b-a21e-af3a72cd70ca None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:04.788261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62284a3-78ac-439b-a21e-af3a72cd70ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:04.793780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f50c15406e4d6bb1a8c44f9a80bd67'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:04.807412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 982/1945] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:04 2022] DELETE /identity/v3/users/b2f50c15406e4d6bb1a8c44f9a80bd67 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:04.809837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a62284a3-78ac-439b-a21e-af3a72cd70ca None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:04.811050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a62284a3-78ac-439b-a21e-af3a72cd70ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:04.813192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:04.815063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:04.867483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:04.886875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 964/1946] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:04.894470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ea5f-5b6a-4fb7-b3f3-456a82907f80 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:04.894879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ea5f-5b6a-4fb7-b3f3-456a82907f80 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:04.895770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ea5f-5b6a-4fb7-b3f3-456a82907f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:04.901779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bcd65-4969-4503-acc1-25da186394d9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:04.905710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:04.906323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:04.906607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:04.906885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:04.908688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:04.917321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4292ea5f-5b6a-4fb7-b3f3-456a82907f80 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:04.918608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4292ea5f-5b6a-4fb7-b3f3-456a82907f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:04.927495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 965/1947] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:04.931743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ea5f-5b6a-4fb7-b3f3-456a82907f80 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:04.941210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ea5f-5b6a-4fb7-b3f3-456a82907f80 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:04.946639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:04.947287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:04.947569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:04.947842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:04.948555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:04.948855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:04.950471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:04.967705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 966/1948] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:04.968631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:04.993858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311c6e-3c7c-4059-b917-bee0011053d4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.006961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:05.007711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.008099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.008509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.010822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.014386 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:05.026035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.027722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:05.047607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 983/1949] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:05.069403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 967/1950] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:04 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:05.072749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:05.093693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0ff4a-003a-410b-83a6-dcb52b31a7d4 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.195917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:05.197157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.197499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.197797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.198566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.201686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:05.284813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 984/1951] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:05 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:05.285653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:05.303390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b45df-8b9c-4722-a5f1-2981f1f09963 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.322514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:05.323987 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.324879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.327361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.331150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.336073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:05.368314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 968/1952] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:05.371879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:05.385374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782fea-7dcc-468d-8876-c1a66d7705ef admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.401898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:05.404046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.404585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.404957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.407712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.412036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:05.441684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:05.442662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 985/1953] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:05.454649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9af96-4edf-483c-b405-a2b489b9f3e4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.460163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:05.462382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:05.463428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2edb6-d7dd-4e12-945a-ab13269a49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:05.465797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2edb6-d7dd-4e12-945a-ab13269a49c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.466303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2edb6-d7dd-4e12-945a-ab13269a49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.466825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2edb6-d7dd-4e12-945a-ab13269a49c4 admin admin] PATH_INFO: `/v3/projects/24f63bc203ff4d6aaa2ebd555cbc00c0/users/0c3495a20e1f4fabb1969f8e779f6ca7/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.486408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea57eb2-5754-4bde-b0e1-a27220eb6e36 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.497453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:05.498109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.498387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.498659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] PATH_INFO: `/v3/projects/500ca1903cef4bcd825cf82d351d583c` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.500509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500ca1903cef4bcd825cf82d351d583c)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.507921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:05.513483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:05.522853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2edb6-d7dd-4e12-945a-ab13269a49c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f63bc203ff4d6aaa2ebd555cbc00c0, user_id=0c3495a20e1f4fabb1969f8e779f6ca7, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.527147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2edb6-d7dd-4e12-945a-ab13269a49c4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:05.562189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 969/1954] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:05 2022] PUT /identity/v3/projects/24f63bc203ff4d6aaa2ebd555cbc00c0/users/0c3495a20e1f4fabb1969f8e779f6ca7/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:05.613072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.613484 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.614825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.652794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500ca1903cef4bcd825cf82d351d583c', 'request_id': 'req-531fef48-623f-4a56-9805-0e9edd87df33'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:05.667178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500ca1903cef4bcd825cf82d351d583c', 'request_id': 'req-531fef48-623f-4a56-9805-0e9edd87df33'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:05.680443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500ca1903cef4bcd825cf82d351d583c', 'request_id': 'req-531fef48-623f-4a56-9805-0e9edd87df33'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:05.681755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] MFA Rules not processed for user `0c3495a20e1f4fabb1969f8e779f6ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:05.685101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:05.704143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] The token cache is being invalidate because project 500ca1903cef4bcd825cf82d351d583c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:05.704802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:05.706147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-531fef48-623f-4a56-9805-0e9edd87df33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:05.715483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 986/1955] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:05 2022] DELETE /identity/v3/projects/500ca1903cef4bcd825cf82d351d583c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:05.720565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca71c1-df36-4d7e-af8b-a7dfd5a75f48 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.720911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca71c1-df36-4d7e-af8b-a7dfd5a75f48 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.721691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca71c1-df36-4d7e-af8b-a7dfd5a75f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.751595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-efca71c1-df36-4d7e-af8b-a7dfd5a75f48 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:05.752826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-efca71c1-df36-4d7e-af8b-a7dfd5a75f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:05.780012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 970/1956] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:05.784671 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:05.792148 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:05.865231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 987/1957] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:05.877163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f075e9-cf8e-48cc-b65d-eb88acb4f8a1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.877604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f075e9-cf8e-48cc-b65d-eb88acb4f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.877885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f075e9-cf8e-48cc-b65d-eb88acb4f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.935509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-11f075e9-cf8e-48cc-b65d-eb88acb4f8a1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:05.937651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-11f075e9-cf8e-48cc-b65d-eb88acb4f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:05.960072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa4a0-577c-4216-9882-c743fb5015d8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.967812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 988/1958] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:05.972555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f075e9-cf8e-48cc-b65d-eb88acb4f8a1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:05.980460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:05.982086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:05.982573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:05.982924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:05.986697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:05.993530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f075e9-cf8e-48cc-b65d-eb88acb4f8a1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:05.993835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.006130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.006855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.008144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.008517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.009548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:06.011232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.014197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.024296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:06.041578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 989/1959] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:06.059050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.071755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 971/1960] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:05 2022] POST /identity/v3/projects => generated 387 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:06.075971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.079767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c639b63-fc15-4ccd-b25d-946a88d48d68 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.178388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ae992-9f33-4ae7-8906-db11aa968336 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.191890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.194040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.194383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.194928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.195591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.198800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.226964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.227597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.227883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.228168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.228835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.234322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.250905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 972/1961] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:06 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:06.257035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.276805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1808-65a2-46ae-9bef-727312a5aa96 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.303976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:06.306621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.307881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.309390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.309930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.311243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.313942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.315374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 990/1962] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:06 2022] POST /identity/v3/projects => generated 369 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:06.319082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.331459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 973/1963] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:06.332452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.345495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501094c-2a28-4b36-b02d-94e50a9b693d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.404826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec182d4-e071-420f-8515-3f1de7824eff admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.409789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.410453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.410859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.411113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.411809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.413978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.420797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.421586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.422131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.422464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] PATH_INFO: `/v3/projects/32380551f9d5462989cc013c1e77ae4b/users/34d6401c048749d287bdb7c70c8a4373/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.438585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 991/1964] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:06 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:06.438780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32380551f9d5462989cc013c1e77ae4b, user_id=34d6401c048749d287bdb7c70c8a4373, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.441529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.443391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.455134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a521e6-f283-4025-91b8-2f6d699a6c2c admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.456073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 974/1965] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:06 2022] PUT /identity/v3/projects/32380551f9d5462989cc013c1e77ae4b/users/34d6401c048749d287bdb7c70c8a4373/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:06.459907 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.516940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:06.524745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.525923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.526213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.526492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.527320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.528864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f975f-93ed-411a-b142-b2572bd6a965 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.528997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.533560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.534170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.534453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.534724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.535362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.537036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.539750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 992/1966] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:06.543773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.547043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 975/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:06.551225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.554248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2057cd4-519f-4fba-ad8d-c83765b994fc admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.559435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.560040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.560361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.560646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.561316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.561630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7d0b-f5ea-4a9d-8050-0f70a3a93e4c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.562931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.566222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04711bf0-9e3e-4f62-afa6-dabc7add64c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.566855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711bf0-9e3e-4f62-afa6-dabc7add64c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.567700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711bf0-9e3e-4f62-afa6-dabc7add64c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.568004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711bf0-9e3e-4f62-afa6-dabc7add64c4 admin admin] PATH_INFO: `/v3/projects/32380551f9d5462989cc013c1e77ae4b/users/34d6401c048749d287bdb7c70c8a4373/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.569942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711bf0-9e3e-4f62-afa6-dabc7add64c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32380551f9d5462989cc013c1e77ae4b, user_id=34d6401c048749d287bdb7c70c8a4373, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.572612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711bf0-9e3e-4f62-afa6-dabc7add64c4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.574116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 993/1968] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:06.578224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.584353 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 976/1969] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:06 2022] PUT /identity/v3/projects/32380551f9d5462989cc013c1e77ae4b/users/34d6401c048749d287bdb7c70c8a4373/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:06.593470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5e2d-c557-4836-ad76-2e4bb5213e48 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.595450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.596255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.596509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.639793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] MFA Rules not processed for user `34d6401c048749d287bdb7c70c8a4373`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:06.641318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:06.657336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e7ad0-1926-4294-9a56-e1ac3815969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.658495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e7ad0-1926-4294-9a56-e1ac3815969f admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.659698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e7ad0-1926-4294-9a56-e1ac3815969f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.660189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e7ad0-1926-4294-9a56-e1ac3815969f admin admin] PATH_INFO: `/v3/projects/710bddfbb2a24fa8be5ecf7be80e4f46/users/798ab8efa3be4caf822ffd87604181d1/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.681476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e7ad0-1926-4294-9a56-e1ac3815969f admin admin] RBAC: Authorizing `identity:create_grant(project_id=710bddfbb2a24fa8be5ecf7be80e4f46, user_id=798ab8efa3be4caf822ffd87604181d1, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:06.684979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e7ad0-1926-4294-9a56-e1ac3815969f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:06.688920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:06.706793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 994/1970] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:06 2022] PUT /identity/v3/projects/710bddfbb2a24fa8be5ecf7be80e4f46/users/798ab8efa3be4caf822ffd87604181d1/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:06.720677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.721871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.721985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.754864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 977/1971] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:06.765574 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.767977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:06.778001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] MFA Rules not processed for user `798ab8efa3be4caf822ffd87604181d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:06.779795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:06.847542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a74a-8ec9-44f1-8e1b-231dfa82255b None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:06.929384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:06.930209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:06.930326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 995/1972] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:06.930417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:06.930633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:06.941741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:06.944675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:06.974380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:07.014379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:07.016852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:07.030958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 978/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:07.066187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:07.072510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdf54b-22b5-4cb9-92ca-4ab8d053913e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:07.076896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71deb66-23b6-4c61-8216-8f17fc7bfc98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:07.077512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71deb66-23b6-4c61-8216-8f17fc7bfc98 service glance] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:07.077953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71deb66-23b6-4c61-8216-8f17fc7bfc98 service glance] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:07.078229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71deb66-23b6-4c61-8216-8f17fc7bfc98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:07.087790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71deb66-23b6-4c61-8216-8f17fc7bfc98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:07.089545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71deb66-23b6-4c61-8216-8f17fc7bfc98 service glance] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:07.112633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 996/1974] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:07.154127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf11e5-ce26-497b-bf39-dab6d0f974e1 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:07.158816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:07.159453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:07.159729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:07.160002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] PATH_INFO: `/v3/users/0c3495a20e1f4fabb1969f8e779f6ca7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:07.161201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3495a20e1f4fabb1969f8e779f6ca7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:07.163158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:07.217214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3495a20e1f4fabb1969f8e779f6ca7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:07.226151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3495a20e1f4fabb1969f8e779f6ca7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:07.226891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3495a20e1f4fabb1969f8e779f6ca7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:07.247810 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3495a20e1f4fabb1969f8e779f6ca7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:07.259852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3495a20e1f4fabb1969f8e779f6ca7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:07.267418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 979/1975] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:07 2022] DELETE /identity/v3/users/0c3495a20e1f4fabb1969f8e779f6ca7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:07.271825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:07.272121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:07.272431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:07.293394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:07.294611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:07.386849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 997/1976] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:07.397415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:07.398903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:07.489697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:07.504021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc0568-8240-4ef4-ba7c-f3b230cd6440 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:07.517971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:07.519752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:07.520922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:07.521783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:07.561859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:07.565702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:07.593023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 980/1977] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:08.206191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:08.210923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:08.237204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68270e-7b69-465d-ae33-83ce22f7e6a1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:08.263800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:08.264680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:08.265577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:08.265791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] PATH_INFO: `/v3/projects/24f63bc203ff4d6aaa2ebd555cbc00c0` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:08.266973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f63bc203ff4d6aaa2ebd555cbc00c0)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:08.268915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:08.275921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:08.309034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:08.310722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:08.336259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d992e-e85d-4bde-8743-baa0a446a75d service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:08.395092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f63bc203ff4d6aaa2ebd555cbc00c0', 'request_id': 'req-906fe200-9b30-4c8d-9707-35568bd2d79d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.408969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f63bc203ff4d6aaa2ebd555cbc00c0', 'request_id': 'req-906fe200-9b30-4c8d-9707-35568bd2d79d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.420346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f63bc203ff4d6aaa2ebd555cbc00c0', 'request_id': 'req-906fe200-9b30-4c8d-9707-35568bd2d79d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.445125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] The token cache is being invalidate because project 24f63bc203ff4d6aaa2ebd555cbc00c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:08.445485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.447095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.454691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 998/1978] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:08 2022] DELETE /identity/v3/projects/24f63bc203ff4d6aaa2ebd555cbc00c0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:08.459213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:08.460865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:08.480292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:08.480962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:08.481503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:08.481784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] PATH_INFO: `/v3/users/4db19cc8219f4fa4b7dc5cda2790697c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:08.483001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db19cc8219f4fa4b7dc5cda2790697c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:08.485110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:08.562807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db19cc8219f4fa4b7dc5cda2790697c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.572711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db19cc8219f4fa4b7dc5cda2790697c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.573364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db19cc8219f4fa4b7dc5cda2790697c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.582360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fe200-9b30-4c8d-9707-35568bd2d79d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:08.588579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:08.588871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db19cc8219f4fa4b7dc5cda2790697c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.589451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:08.589832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:08.596549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] PATH_INFO: `/v3/users/34d6401c048749d287bdb7c70c8a4373` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:08.596549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d6401c048749d287bdb7c70c8a4373)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:08.601004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:08.604057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-de9d1c8e-856f-4d4b-8bca-87a662aeff8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db19cc8219f4fa4b7dc5cda2790697c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.612323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 981/1979] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:08 2022] DELETE /identity/v3/users/4db19cc8219f4fa4b7dc5cda2790697c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:08.615438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:08.615745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:08.616019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:08.638676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:08.639848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:08.668636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d6401c048749d287bdb7c70c8a4373'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.681268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d6401c048749d287bdb7c70c8a4373'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.683512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d6401c048749d287bdb7c70c8a4373'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.693933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d6401c048749d287bdb7c70c8a4373'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.730895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d6401c048749d287bdb7c70c8a4373'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:08.747496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 982/1980] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:08.755088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:08.756706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:08.761333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 999/1981] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:08 2022] DELETE /identity/v3/users/34d6401c048749d287bdb7c70c8a4373 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:08.780311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:08.881360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827878-3f79-4358-b8a9-cbf4252d74f1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:08.998618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550a9b2-105d-45a4-abb8-61ab6ce9e7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:08.999331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a9b2-105d-45a4-abb8-61ab6ce9e7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:08.999865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a9b2-105d-45a4-abb8-61ab6ce9e7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.000138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a9b2-105d-45a4-abb8-61ab6ce9e7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.086215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550a9b2-105d-45a4-abb8-61ab6ce9e7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.087703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550a9b2-105d-45a4-abb8-61ab6ce9e7e1 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.098339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 983/1982] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:09.186391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.188214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:09.205891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dcd30-6283-4312-b7ed-cf089ca29730 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:09.212522 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:09.213193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.213435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.213757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] PATH_INFO: `/v3/projects/32380551f9d5462989cc013c1e77ae4b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.214959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32380551f9d5462989cc013c1e77ae4b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.217128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.224891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:09.274834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32380551f9d5462989cc013c1e77ae4b', 'request_id': 'req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.283888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32380551f9d5462989cc013c1e77ae4b', 'request_id': 'req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.295133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32380551f9d5462989cc013c1e77ae4b', 'request_id': 'req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.314786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] The token cache is being invalidate because project 32380551f9d5462989cc013c1e77ae4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:09.315278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.316135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ac28f1b7-cd34-4365-9ad8-04649cb1a85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.319838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1000/1983] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:09 2022] DELETE /identity/v3/projects/32380551f9d5462989cc013c1e77ae4b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:09.324667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e33c-17c3-43ea-b828-5a6a1dd46a84 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.325213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e33c-17c3-43ea-b828-5a6a1dd46a84 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.325396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e33c-17c3-43ea-b828-5a6a1dd46a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.352820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5466e33c-17c3-43ea-b828-5a6a1dd46a84 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:09.355982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5466e33c-17c3-43ea-b828-5a6a1dd46a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:09.427236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 984/1984] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:09.435407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.435699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.435994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.458983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:09.460237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:09.475532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1001/1985] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:09.481064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466e33c-17c3-43ea-b828-5a6a1dd46a84 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.514267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466e33c-17c3-43ea-b828-5a6a1dd46a84 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:09.521318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:09.521954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.522381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.522743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.531751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.533214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:09.541121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:09.541433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.543161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.557709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c729490-a9b6-4b27-97b0-a8b8367bd914 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:09.572505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:09.591113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 985/1986] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:09.596143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.596328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.598864 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.601646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] PATH_INFO: `/v3/projects/d9a9ac976e4044a389231eb1c6c46aea` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.616181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:09.617377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a9ac976e4044a389231eb1c6c46aea)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.620794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.625989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057c703-a4e2-43df-81f1-21dcf789ef69 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:09.645829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:09.646459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.647294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.647294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.647636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.649613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.702977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a9ac976e4044a389231eb1c6c46aea', 'request_id': 'req-805a3391-7b58-4cf1-9ed6-a6e41d79068a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.704523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 986/1987] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:09 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:09.708542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.722031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a9ac976e4044a389231eb1c6c46aea', 'request_id': 'req-805a3391-7b58-4cf1-9ed6-a6e41d79068a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.729674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a9ac976e4044a389231eb1c6c46aea', 'request_id': 'req-805a3391-7b58-4cf1-9ed6-a6e41d79068a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.746894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] The token cache is being invalidate because project d9a9ac976e4044a389231eb1c6c46aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:09.747292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.748136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.750484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1002/1988] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:09 2022] DELETE /identity/v3/projects/d9a9ac976e4044a389231eb1c6c46aea => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:09.755995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.761049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:09.858326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530f5a5-4c44-4c9d-829d-bae059469bd7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:09.866219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:09.866999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.867409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.867787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.868582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.870769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.878542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a3391-7b58-4cf1-9ed6-a6e41d79068a admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:09.884391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:09.885454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.886058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.886575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] PATH_INFO: `/v3/users/241f411880d54c2f9961cfb55cbef343` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.888117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=241f411880d54c2f9961cfb55cbef343)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.890401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.902526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 987/1989] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:09 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:09.907222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.909879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:09.912026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:09.939811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b59a6-b749-4cac-b439-4938bcaf1dbb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:09.951548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:09.952580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:09.953017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:09.953441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:09.954723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:09.956658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:09.963243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241f411880d54c2f9961cfb55cbef343'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.969794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 988/1990] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:09.975478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:09.976117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241f411880d54c2f9961cfb55cbef343'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.977269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241f411880d54c2f9961cfb55cbef343'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.987672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241f411880d54c2f9961cfb55cbef343'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:09.997428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944474d-8e39-4475-967f-f28794080b1a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.005068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85969eac-be9c-42f1-a1ad-160ce8376107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.006209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969eac-be9c-42f1-a1ad-160ce8376107 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.006695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969eac-be9c-42f1-a1ad-160ce8376107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.007637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969eac-be9c-42f1-a1ad-160ce8376107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.008804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85969eac-be9c-42f1-a1ad-160ce8376107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.009395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241f411880d54c2f9961cfb55cbef343'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:10.011262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85969eac-be9c-42f1-a1ad-160ce8376107 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.020997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1003/1991] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:09 2022] DELETE /identity/v3/users/241f411880d54c2f9961cfb55cbef343 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:10.032460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 989/1992] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:10.041679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:10.043229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:10.144932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277b416-cbee-43e7-a194-bcec50ada35e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.150315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.151105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.151540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.152074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] PATH_INFO: `/v3/projects/6e83f2cce238482a95ee8d88ede5e446/users/05f03eb750f944fca87230a757fb7c05/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.206282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e83f2cce238482a95ee8d88ede5e446, user_id=05f03eb750f944fca87230a757fb7c05, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.213383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.238563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1004/1993] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:10 2022] PUT /identity/v3/projects/6e83f2cce238482a95ee8d88ede5e446/users/05f03eb750f944fca87230a757fb7c05/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:10.250900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9d49-b4dc-4a5f-8337-245d727f308c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.251330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9d49-b4dc-4a5f-8337-245d727f308c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.251721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9d49-b4dc-4a5f-8337-245d727f308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.284558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-de4e9d49-b4dc-4a5f-8337-245d727f308c None None] MFA Rules not processed for user `05f03eb750f944fca87230a757fb7c05`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:10.289710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-de4e9d49-b4dc-4a5f-8337-245d727f308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:10.382681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 990/1994] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:10.388139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:10.472894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc5a3-b9e7-4dd5-bd75-5869a02c147d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.479258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.480235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.481246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.481246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.481810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.487456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.510659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:10.523808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9d49-b4dc-4a5f-8337-245d727f308c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:10.524393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1005/1995] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:10 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:10.536682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9d49-b4dc-4a5f-8337-245d727f308c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.592610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:10.633343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.634636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.634636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.635804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.636677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.640152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.680929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:10.691312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 991/1996] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:10 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:10.698432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac8bb-15a7-42ec-a275-35b564b117a0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.704378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.705312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.705747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.706274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.707330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.710059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.730819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:10.743674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1006/1997] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:10.747924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b267fc-e2b1-41c9-a066-35c1a611023d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.753301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.754078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.754525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.754903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] PATH_INFO: `/v3/projects/d021638c9a0c49f49fa4da24a43afe8b/users/68eb1be2f40a499da197f0c786a48ffb/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.787562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d021638c9a0c49f49fa4da24a43afe8b, user_id=68eb1be2f40a499da197f0c786a48ffb, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.791243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.826306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 992/1998] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:10 2022] PUT /identity/v3/projects/d021638c9a0c49f49fa4da24a43afe8b/users/68eb1be2f40a499da197f0c786a48ffb/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:10.831100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:10.844871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cae5e-861c-42da-9b4b-2d9e3c522b18 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.939614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2ca9-aff8-4c83-b184-e7b1a38c769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.940462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2ca9-aff8-4c83-b184-e7b1a38c769c admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.940791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2ca9-aff8-4c83-b184-e7b1a38c769c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.941173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2ca9-aff8-4c83-b184-e7b1a38c769c admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.942023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2ca9-aff8-4c83-b184-e7b1a38c769c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.943876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2ca9-aff8-4c83-b184-e7b1a38c769c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.957285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1007/1999] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:10.962292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:10.973950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8506-062f-4478-b572-b493f0b15838 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:10.982100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:10.982790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:10.983080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:10.983356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] PATH_INFO: `/v3/projects/d021638c9a0c49f49fa4da24a43afe8b/users/68eb1be2f40a499da197f0c786a48ffb/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:10.985365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d021638c9a0c49f49fa4da24a43afe8b, user_id=68eb1be2f40a499da197f0c786a48ffb, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:10.988110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:10.999821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 993/2000] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:10 2022] PUT /identity/v3/projects/d021638c9a0c49f49fa4da24a43afe8b/users/68eb1be2f40a499da197f0c786a48ffb/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:11.010323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:11.010621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:11.010902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:11.041765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] MFA Rules not processed for user `68eb1be2f40a499da197f0c786a48ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:11.043105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:11.129606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1008/2001] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:11.142863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:11.145676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:11.211329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f7594-8d9c-4cba-a82b-874530d73c38 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:11.218502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:11.219237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:11.219540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:11.219802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:11.231628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:11.233222 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:11.243903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 994/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:11.326853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:11.331008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:11.337238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:11.354446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194fc60-d3e4-4ba6-aa7c-64c4886f3dc4 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:11.358332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:11.358945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:11.359296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:11.359568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:11.420612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c1f9d-99d8-414e-a932-e191a175a6a9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:11.425835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:11.427043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:11.427325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:11.427598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] PATH_INFO: `/v3/projects/3a5abb0fb41b4bb89297a4f9a3bdd6bc` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:11.428779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5abb0fb41b4bb89297a4f9a3bdd6bc)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:11.430700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:11.444008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:11.459559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:11.464823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:11.477689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 995/2003] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:11.497851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5abb0fb41b4bb89297a4f9a3bdd6bc', 'request_id': 'req-cd88376b-374b-42a0-a9f8-ea979adeca34'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.511727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5abb0fb41b4bb89297a4f9a3bdd6bc', 'request_id': 'req-cd88376b-374b-42a0-a9f8-ea979adeca34'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.518957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5abb0fb41b4bb89297a4f9a3bdd6bc', 'request_id': 'req-cd88376b-374b-42a0-a9f8-ea979adeca34'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.534324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] The token cache is being invalidate because project 3a5abb0fb41b4bb89297a4f9a3bdd6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:11.535223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.536458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.539057 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1009/2004] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:11 2022] DELETE /identity/v3/projects/3a5abb0fb41b4bb89297a4f9a3bdd6bc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:11.542793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:11.558130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1b80-53cd-4da9-b42a-4e2f75f9fed2 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:11.606802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:11.661690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:11.663097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:11.663528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:11.664174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] PATH_INFO: `/v3/users/923e28ec56a8405b8735bcc52bd3ef0d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:11.666872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] RBAC: Authorizing `identity:delete_user(user_id=923e28ec56a8405b8735bcc52bd3ef0d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:11.670733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:11.779292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923e28ec56a8405b8735bcc52bd3ef0d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.790008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923e28ec56a8405b8735bcc52bd3ef0d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.790906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923e28ec56a8405b8735bcc52bd3ef0d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.812823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923e28ec56a8405b8735bcc52bd3ef0d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.822616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9538f4e8-2ffb-4a0c-a065-7f0fe413001d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923e28ec56a8405b8735bcc52bd3ef0d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:11.833890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 996/2005] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:11 2022] DELETE /identity/v3/users/923e28ec56a8405b8735bcc52bd3ef0d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:12.433345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:12.434923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:12.463179 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88376b-374b-42a0-a9f8-ea979adeca34 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:12.528398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:12.529129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:12.529479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:12.529763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] PATH_INFO: `/v3/projects/cad55583a89c486dad32499cae637e99` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:12.530963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad55583a89c486dad32499cae637e99)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:12.532935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:12.581127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad55583a89c486dad32499cae637e99', 'request_id': 'req-8158da13-dba9-4d7e-a877-63446d74ae37'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:12.601190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad55583a89c486dad32499cae637e99', 'request_id': 'req-8158da13-dba9-4d7e-a877-63446d74ae37'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:12.610086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad55583a89c486dad32499cae637e99', 'request_id': 'req-8158da13-dba9-4d7e-a877-63446d74ae37'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:12.622871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] The token cache is being invalidate because project cad55583a89c486dad32499cae637e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:12.623806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:12.623919 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-8158da13-dba9-4d7e-a877-63446d74ae37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:12.630788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1010/2006] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:12 2022] DELETE /identity/v3/projects/cad55583a89c486dad32499cae637e99 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:12.633004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22081-6e80-4da9-8e45-0423728bccec None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:12.633542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22081-6e80-4da9-8e45-0423728bccec None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:12.633813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22081-6e80-4da9-8e45-0423728bccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:12.656720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-57a22081-6e80-4da9-8e45-0423728bccec None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:12.658036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-57a22081-6e80-4da9-8e45-0423728bccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:12.735491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 997/2007] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:12.745379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dc458-102d-4737-b33f-a6bb6976595b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:12.745665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dc458-102d-4737-b33f-a6bb6976595b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:12.745942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dc458-102d-4737-b33f-a6bb6976595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:12.769365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-819dc458-102d-4737-b33f-a6bb6976595b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:12.771860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-819dc458-102d-4737-b33f-a6bb6976595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:12.792871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1011/2008] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:12.796881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22081-6e80-4da9-8e45-0423728bccec None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:12.808727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22081-6e80-4da9-8e45-0423728bccec None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:12.815515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:12.816379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:12.816718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:12.817023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:12.817778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:12.818070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:12.820207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:12.836750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 998/2009] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:12.838045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dc458-102d-4737-b33f-a6bb6976595b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:12.853452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dc458-102d-4737-b33f-a6bb6976595b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:12.858642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:12.859330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:12.859678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:12.860047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:12.860786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:12.863315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:12.889234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:12.905294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1012/2010] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:12 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:12.906912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:12.919044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5aa7-2272-4be8-8aad-5ced4a967855 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:12.953933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:12.981924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:12.982712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:12.983028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:12.983299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:12.984079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:12.986360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.011113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 999/2011] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:12 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:13.015424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.027418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe2d37-2865-4134-9a8c-ee9a00e5c5bb admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.032396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.032945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.033227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.033505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.034597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.036543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.052904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1013/2012] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:13.054051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.074755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf28880-ef8b-4c4b-a4d1-fa780c11b229 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.079611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65ce13-1da7-4df2-9dc1-044429a31292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.080405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ce13-1da7-4df2-9dc1-044429a31292 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.080690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ce13-1da7-4df2-9dc1-044429a31292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.080963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ce13-1da7-4df2-9dc1-044429a31292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.081614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65ce13-1da7-4df2-9dc1-044429a31292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.084585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65ce13-1da7-4df2-9dc1-044429a31292 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.100082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1000/2013] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:13.101289 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.113088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05df0e9-7b0a-4bd5-94e1-279cdc404214 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.124206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.126199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.126540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.126833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] PATH_INFO: `/v3/projects/3582639a2da546cbbdbf3b40051300a0/users/2e335aa280684608b12e0fc3adad78d2/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.162169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3582639a2da546cbbdbf3b40051300a0, user_id=2e335aa280684608b12e0fc3adad78d2, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.164818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.189095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1014/2014] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:13 2022] PUT /identity/v3/projects/3582639a2da546cbbdbf3b40051300a0/users/2e335aa280684608b12e0fc3adad78d2/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:13.203950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c507b12-32e8-4db4-abde-5fd97652a116 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.204063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c507b12-32e8-4db4-abde-5fd97652a116 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.204307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c507b12-32e8-4db4-abde-5fd97652a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.266099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2c507b12-32e8-4db4-abde-5fd97652a116 None None] MFA Rules not processed for user `2e335aa280684608b12e0fc3adad78d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:13.268055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2c507b12-32e8-4db4-abde-5fd97652a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:13.457853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1001/2015] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:13.462181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.578698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf89e-9473-40fc-bbd7-8e27cbf7bc81 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.586619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.587332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.587615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.587936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.588812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.590810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.625260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1015/2016] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:13 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:13.630307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c507b12-32e8-4db4-abde-5fd97652a116 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.646328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c507b12-32e8-4db4-abde-5fd97652a116 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.717334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.718277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.718613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.718885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.719525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.721482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.743071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1002/2017] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:13 2022] POST /identity/v3/users => generated 306 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:13.747209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.758292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19de0b-bc39-4be7-9f8d-5bb095fc255b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.763163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.763774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.764056 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.764368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.765152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.766899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.780323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1016/2018] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:13.783269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.795868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04c33-e2ca-4317-b739-8cfb12d84115 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.800968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.801685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.802114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.802387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] PATH_INFO: `/v3/projects/e5cecb9ce2284879878da34930d9de2c/users/650240118fee463491adb6227a1d441c/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.825511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cecb9ce2284879878da34930d9de2c, user_id=650240118fee463491adb6227a1d441c, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.828656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.849116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1003/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:13 2022] PUT /identity/v3/projects/e5cecb9ce2284879878da34930d9de2c/users/650240118fee463491adb6227a1d441c/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:13.853468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.865917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6081e74-0978-4b84-87e1-6834b5993c0e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.927332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31524f-e368-4435-a221-df564f2edfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.927996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31524f-e368-4435-a221-df564f2edfbe admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.928316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31524f-e368-4435-a221-df564f2edfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.928594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31524f-e368-4435-a221-df564f2edfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.929327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31524f-e368-4435-a221-df564f2edfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.931153 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31524f-e368-4435-a221-df564f2edfbe admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.941099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1017/2020] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:13.945263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:13.956081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd1792-6109-4f98-87e5-79de84755664 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:13.961787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:13.962467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.962749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.963027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] PATH_INFO: `/v3/projects/e5cecb9ce2284879878da34930d9de2c/users/650240118fee463491adb6227a1d441c/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:13.965022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cecb9ce2284879878da34930d9de2c, user_id=650240118fee463491adb6227a1d441c, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:13.967800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:13.973999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:13.980356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1004/2021] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:13 2022] PUT /identity/v3/projects/e5cecb9ce2284879878da34930d9de2c/users/650240118fee463491adb6227a1d441c/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:13.991782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed8af-d891-415c-a112-80aa08968eea None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:13.992078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed8af-d891-415c-a112-80aa08968eea None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:13.992423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed8af-d891-415c-a112-80aa08968eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:14.021865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-bfeed8af-d891-415c-a112-80aa08968eea None None] MFA Rules not processed for user `650240118fee463491adb6227a1d441c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:14.023144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bfeed8af-d891-415c-a112-80aa08968eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:14.048983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:14.097860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1018/2022] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:14.109654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:14.111626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:14.174130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f990-cca8-49d0-b882-e8c66ceeabe2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:14.178675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:14.179293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:14.179572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:14.179840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:14.191647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:14.193862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:14.211701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1005/2023] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:14.307665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeed8af-d891-415c-a112-80aa08968eea None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:14.319627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeed8af-d891-415c-a112-80aa08968eea None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:14.323627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0429f-8c44-427a-a3ec-33392beb4f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:14.324382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0429f-8c44-427a-a3ec-33392beb4f3c service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:14.324758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0429f-8c44-427a-a3ec-33392beb4f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:14.325310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0429f-8c44-427a-a3ec-33392beb4f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:14.409267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0429f-8c44-427a-a3ec-33392beb4f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:14.411106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0429f-8c44-427a-a3ec-33392beb4f3c service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:14.424840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1019/2024] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:14 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:17.256217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:17.258475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:17.413097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09909c02-4b3c-4eee-af19-f8c9d8cfe3dc service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:17.420261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:17.420943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:17.421225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:17.421500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] PATH_INFO: `/v3/users/05f03eb750f944fca87230a757fb7c05` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:17.433219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f03eb750f944fca87230a757fb7c05)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:17.435448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:17.527717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f03eb750f944fca87230a757fb7c05'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:17.539715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f03eb750f944fca87230a757fb7c05'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:17.540354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f03eb750f944fca87230a757fb7c05'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:17.562396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f03eb750f944fca87230a757fb7c05'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:17.581163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f03eb750f944fca87230a757fb7c05'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:17.591084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1006/2025] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:17 2022] DELETE /identity/v3/users/05f03eb750f944fca87230a757fb7c05 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:17.596346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:17.599393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:17.599818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:17.644060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:17.648666 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:17.772522 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1020/2026] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:17.782580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:17.784194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:17.814605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:17.899414 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc6579-d474-4722-84e8-aa8d1e07f798 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:17.904078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:17.904865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:17.906519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:17.906922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:17.920571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:17.922467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:17.939997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1007/2027] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:18.289306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:18.291098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:18.303576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37342b-e9c1-447d-b20b-eec0c8ab020e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:18.308637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:18.309277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:18.309559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:18.309833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] PATH_INFO: `/v3/projects/6e83f2cce238482a95ee8d88ede5e446` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:18.310959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e83f2cce238482a95ee8d88ede5e446)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:18.312904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:18.361123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e83f2cce238482a95ee8d88ede5e446', 'request_id': 'req-67e87c5c-215e-468b-a355-51e6883f929f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.365044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:18.370132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e83f2cce238482a95ee8d88ede5e446', 'request_id': 'req-67e87c5c-215e-468b-a355-51e6883f929f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.377494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e83f2cce238482a95ee8d88ede5e446', 'request_id': 'req-67e87c5c-215e-468b-a355-51e6883f929f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.389527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] The token cache is being invalidate because project 6e83f2cce238482a95ee8d88ede5e446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:18.389820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.390478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.391979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1021/2028] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:18 2022] DELETE /identity/v3/projects/6e83f2cce238482a95ee8d88ede5e446 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:18.396092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:18.405850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4611f2-c42d-4e14-864c-a2b16490e906 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:18.462898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:18.463536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:18.463816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:18.464087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] PATH_INFO: `/v3/users/68eb1be2f40a499da197f0c786a48ffb` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:18.465245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68eb1be2f40a499da197f0c786a48ffb)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:18.467195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:18.512872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68eb1be2f40a499da197f0c786a48ffb'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.521163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68eb1be2f40a499da197f0c786a48ffb'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.522011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68eb1be2f40a499da197f0c786a48ffb'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.534208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68eb1be2f40a499da197f0c786a48ffb'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.541322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-36d6565b-30a5-42b6-8e8e-b5a428abea31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68eb1be2f40a499da197f0c786a48ffb'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.547521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1008/2029] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:18 2022] DELETE /identity/v3/users/68eb1be2f40a499da197f0c786a48ffb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:18.827810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:18.829393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:18.844335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e87c5c-215e-468b-a355-51e6883f929f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:18.905271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:18.905901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:18.906182 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:18.906457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] PATH_INFO: `/v3/projects/d021638c9a0c49f49fa4da24a43afe8b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:18.907609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d021638c9a0c49f49fa4da24a43afe8b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:18.909620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:18.974079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd021638c9a0c49f49fa4da24a43afe8b', 'request_id': 'req-6ce58122-f5a8-46dd-9e82-15fb8ff07308'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.987742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd021638c9a0c49f49fa4da24a43afe8b', 'request_id': 'req-6ce58122-f5a8-46dd-9e82-15fb8ff07308'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:18.995656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd021638c9a0c49f49fa4da24a43afe8b', 'request_id': 'req-6ce58122-f5a8-46dd-9e82-15fb8ff07308'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.010829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] The token cache is being invalidate because project d021638c9a0c49f49fa4da24a43afe8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:19.011168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.011822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6ce58122-f5a8-46dd-9e82-15fb8ff07308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.013890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1022/2030] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:18 2022] DELETE /identity/v3/projects/d021638c9a0c49f49fa4da24a43afe8b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:19.018223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.018523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.018806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.049341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:19.050572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.098630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:19.123602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1009/2031] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:19.132366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9187e0-a375-47ab-a92c-e45564c032b4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.132657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9187e0-a375-47ab-a92c-e45564c032b4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.133058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9187e0-a375-47ab-a92c-e45564c032b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.150937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.152699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.155665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-2f9187e0-a375-47ab-a92c-e45564c032b4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:19.157585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2f9187e0-a375-47ab-a92c-e45564c032b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.165756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e171-7c4b-40ea-944f-518ffd2716c4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.166830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1023/2032] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:19.170603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.170861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9187e0-a375-47ab-a92c-e45564c032b4 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.171381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.171666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.171945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] PATH_INFO: `/v3/users/2e335aa280684608b12e0fc3adad78d2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.173213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e335aa280684608b12e0fc3adad78d2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.175140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.180497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9187e0-a375-47ab-a92c-e45564c032b4 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.185429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.186085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.186373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.186659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.187321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:19.187630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.189264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.201518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1024/2033] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:29:19.208192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.218490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e347f-f08e-4b65-8e56-b786d9744ab2 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.226547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.227257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.227409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e335aa280684608b12e0fc3adad78d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.227579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.227831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.228514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.230431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.235276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e335aa280684608b12e0fc3adad78d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.235971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e335aa280684608b12e0fc3adad78d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.250590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e335aa280684608b12e0fc3adad78d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.258224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b18d2be8-2a8c-4a26-b021-54d1ff3bff8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e335aa280684608b12e0fc3adad78d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.266613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1025/2034] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:19.266797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1010/2035] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:19 2022] DELETE /identity/v3/users/2e335aa280684608b12e0fc3adad78d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:19.268014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.269381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.270228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.270412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.270513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.290359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:19.292290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.307331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:19.346670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edaa40-4ad8-4552-9ed0-dfa9d56cb6ae admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.367734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1011/2036] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:19.379955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.381354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.421263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.421793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.422119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.422343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.423101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.425198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.439991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614672f-ea22-4fe5-bdfe-04235e7ca49c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.456345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.456345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.456345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.456345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.461520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.463159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.466341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1026/2037] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:19.467257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:19.468007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.478599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0b896-954b-4be1-ace5-f093dd8057ab admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.480590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1012/2038] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:19.483651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.484258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.484567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.484842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.485489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.487075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.498404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1027/2039] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:19.502499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.512694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b169a-fbbe-4714-8d36-3501bc46eb5a service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.517346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd534-c2cf-4149-a01c-544e124a7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.517985 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd534-c2cf-4149-a01c-544e124a7811 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.518264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd534-c2cf-4149-a01c-544e124a7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.518572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd534-c2cf-4149-a01c-544e124a7811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.519216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edd534-c2cf-4149-a01c-544e124a7811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.521502 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edd534-c2cf-4149-a01c-544e124a7811 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.533605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1013/2040] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:19.538304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.549579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63101-0816-4ade-8d50-587666a98e49 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.555489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.556162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.556478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.556753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] PATH_INFO: `/v3/projects/87c5d448515248bbb5145ec804c77c6f/users/3043486ffcbd415d9149f1cccb9df61b/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.572405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c5d448515248bbb5145ec804c77c6f, user_id=3043486ffcbd415d9149f1cccb9df61b, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.575115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.589278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1028/2041] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:19 2022] PUT /identity/v3/projects/87c5d448515248bbb5145ec804c77c6f/users/3043486ffcbd415d9149f1cccb9df61b/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:19.600125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.600666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.601304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.637255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] MFA Rules not processed for user `3043486ffcbd415d9149f1cccb9df61b`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:19.638720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.712043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1014/2042] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:19.716694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.765632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.767228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:19.801737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7524-56b0-4331-b8e3-0b894bf53b72 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.806833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.807470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.807747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.808017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.808686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.810682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.842903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9794e6-8dc7-4c00-a9b6-7a2d2a2ed9af None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.844079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1029/2043] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:19.847712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.871888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:19.908633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.909274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.909581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.909862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] PATH_INFO: `/v3/projects/3582639a2da546cbbdbf3b40051300a0` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.911355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3582639a2da546cbbdbf3b40051300a0)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.913476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.932271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7326-c9c5-4892-9750-b64158a0c716 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.937359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:19.937999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:19.938280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:19.938549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:19.939176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:19.941505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:19.945994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:19.964390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3582639a2da546cbbdbf3b40051300a0', 'request_id': 'req-227b986d-126b-4145-9e92-f00a2764032b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.966633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1030/2044] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:19 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:19.970733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:19.973732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3582639a2da546cbbdbf3b40051300a0', 'request_id': 'req-227b986d-126b-4145-9e92-f00a2764032b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.980145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3582639a2da546cbbdbf3b40051300a0', 'request_id': 'req-227b986d-126b-4145-9e92-f00a2764032b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.980355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e701d-01b8-4953-95aa-0f53ac263727 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:19.994731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] The token cache is being invalidate because project 3582639a2da546cbbdbf3b40051300a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:19.995007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.995662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:19.997213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1015/2045] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:19 2022] DELETE /identity/v3/projects/3582639a2da546cbbdbf3b40051300a0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:20.001438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.002822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.041215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.041828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.042261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.042597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.043273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.044918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.055570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1031/2046] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:20.059712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.061463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.076592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2ca0e-3c0f-4b09-bc91-74557e3ee3b9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.081357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.082018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.082332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.082610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] PATH_INFO: `/v3/projects/d1f34fa9c7484eba8178d135b88e8746/users/dbced633ef2d412cb67112d94d492263/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.082920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b986d-126b-4145-9e92-f00a2764032b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.088365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.088994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.089270 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.089541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] PATH_INFO: `/v3/users/650240118fee463491adb6227a1d441c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.090664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=650240118fee463491adb6227a1d441c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.092613 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.097924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f34fa9c7484eba8178d135b88e8746, user_id=dbced633ef2d412cb67112d94d492263, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.100631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.122080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1032/2047] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:20 2022] PUT /identity/v3/projects/d1f34fa9c7484eba8178d135b88e8746/users/dbced633ef2d412cb67112d94d492263/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:20.126575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.149954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650240118fee463491adb6227a1d441c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.158356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650240118fee463491adb6227a1d441c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.159020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650240118fee463491adb6227a1d441c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.173622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650240118fee463491adb6227a1d441c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.182227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650240118fee463491adb6227a1d441c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.189772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1016/2048] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:20 2022] DELETE /identity/v3/users/650240118fee463491adb6227a1d441c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:20.250578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3fb3-142e-4b73-8bb0-d605e9ed8d98 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.319094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:20.367859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddacfb0-1346-464f-9c85-30f35b3d8196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.368788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddacfb0-1346-464f-9c85-30f35b3d8196 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.368788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddacfb0-1346-464f-9c85-30f35b3d8196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.369240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddacfb0-1346-464f-9c85-30f35b3d8196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.369886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddacfb0-1346-464f-9c85-30f35b3d8196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.371923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddacfb0-1346-464f-9c85-30f35b3d8196 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.385692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1033/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:20.386584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.388039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.401963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba309b8-f3e3-4612-8caa-72c531c9a4bf admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.407345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.408014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.408322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.408599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] PATH_INFO: `/v3/projects/d1f34fa9c7484eba8178d135b88e8746/users/dbced633ef2d412cb67112d94d492263/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.411167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f34fa9c7484eba8178d135b88e8746, user_id=dbced633ef2d412cb67112d94d492263, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.413859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.428352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1017/2050] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:20 2022] PUT /identity/v3/projects/d1f34fa9c7484eba8178d135b88e8746/users/dbced633ef2d412cb67112d94d492263/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:20.440334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.440334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.440334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.491491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] MFA Rules not processed for user `dbced633ef2d412cb67112d94d492263`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:20.492770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.553383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.555233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.596892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:20.601246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1034/2051] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:20.613099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.617591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.659078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da6e66-93c7-4b7f-8a49-4001a74bfb92 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.675577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.676802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.677085 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.677361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] PATH_INFO: `/v3/projects/e5cecb9ce2284879878da34930d9de2c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.678495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cecb9ce2284879878da34930d9de2c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.680507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.688045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6f0a-d5fa-41cd-b32a-ad6bd2464d39 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.692477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e9c1c-b890-4bc1-b24a-09db5d27a675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.693020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e9c1c-b890-4bc1-b24a-09db5d27a675 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.693292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e9c1c-b890-4bc1-b24a-09db5d27a675 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.693553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e9c1c-b890-4bc1-b24a-09db5d27a675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.702457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e9c1c-b890-4bc1-b24a-09db5d27a675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.703879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e9c1c-b890-4bc1-b24a-09db5d27a675 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.719510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1035/2052] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:20.732530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cecb9ce2284879878da34930d9de2c', 'request_id': 'req-697919e4-e4fa-4a9a-8ac1-62993924bf12'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.738176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cecb9ce2284879878da34930d9de2c', 'request_id': 'req-697919e4-e4fa-4a9a-8ac1-62993924bf12'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.746102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cecb9ce2284879878da34930d9de2c', 'request_id': 'req-697919e4-e4fa-4a9a-8ac1-62993924bf12'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.759287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] The token cache is being invalidate because project e5cecb9ce2284879878da34930d9de2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:20.759582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.760242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-697919e4-e4fa-4a9a-8ac1-62993924bf12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:20.761914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1018/2053] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:20 2022] DELETE /identity/v3/projects/e5cecb9ce2284879878da34930d9de2c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:20.766791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44521c5-6e74-4a67-ba13-13e1de770274 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.767078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44521c5-6e74-4a67-ba13-13e1de770274 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.767356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44521c5-6e74-4a67-ba13-13e1de770274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.787232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e44521c5-6e74-4a67-ba13-13e1de770274 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:20.788470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e44521c5-6e74-4a67-ba13-13e1de770274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.838154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:20.858520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1036/2054] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:20.866797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15737d-82c6-4c19-9509-b777306815c7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.867101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15737d-82c6-4c19-9509-b777306815c7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.867371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15737d-82c6-4c19-9509-b777306815c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.892470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fd15737d-82c6-4c19-9509-b777306815c7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:20.894425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fd15737d-82c6-4c19-9509-b777306815c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:20.903159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1019/2055] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:20.909349 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44521c5-6e74-4a67-ba13-13e1de770274 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.921873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44521c5-6e74-4a67-ba13-13e1de770274 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.932149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.932872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.933326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.933702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.934445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:20.934879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.936638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:20.949778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1037/2056] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:20.953936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15737d-82c6-4c19-9509-b777306815c7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:20.972446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15737d-82c6-4c19-9509-b777306815c7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:20.972446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:20.972446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:20.972446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:20.972977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:20.972977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:20.974154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.007368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1020/2057] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:20 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:21.009052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.022692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c9a3-3086-4293-888f-1d37e1facd33 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.078085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.078741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.079023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.079297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.080028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.082187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.104855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1038/2058] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:21 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:21.108975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.119797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10fc2a-3010-4a13-aaf0-20e77d2cc6df admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.124535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.125398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.125696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.126013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.126668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.128269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.148339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1021/2059] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:21.149651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.164435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c0af-5007-45c4-8795-39220a03f678 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.170101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ff00c-5b8b-4012-8129-a1277c7af88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.171100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ff00c-5b8b-4012-8129-a1277c7af88a admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.171245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ff00c-5b8b-4012-8129-a1277c7af88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.171500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ff00c-5b8b-4012-8129-a1277c7af88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.172151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ff00c-5b8b-4012-8129-a1277c7af88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.174122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ff00c-5b8b-4012-8129-a1277c7af88a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.186904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1039/2060] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:21.190918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.202144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc7290-cebf-4bde-a34b-293ff97d4dd2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.208881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.209570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.209847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.210123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] PATH_INFO: `/v3/projects/679ca51e4c9c408ba8d5c4ec21f633b9/users/f6af6a00a69d4bcc852270692f4887a2/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.226764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=679ca51e4c9c408ba8d5c4ec21f633b9, user_id=f6af6a00a69d4bcc852270692f4887a2, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.229540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.243157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1022/2061] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:21 2022] PUT /identity/v3/projects/679ca51e4c9c408ba8d5c4ec21f633b9/users/f6af6a00a69d4bcc852270692f4887a2/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:21.258427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe345-05b8-4f6f-b5d3-d297fa7b8331 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.258715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe345-05b8-4f6f-b5d3-d297fa7b8331 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.258989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe345-05b8-4f6f-b5d3-d297fa7b8331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.287466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-54cfe345-05b8-4f6f-b5d3-d297fa7b8331 None None] MFA Rules not processed for user `f6af6a00a69d4bcc852270692f4887a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:21.288749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-54cfe345-05b8-4f6f-b5d3-d297fa7b8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:21.358565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1040/2062] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:21.359248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.361807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:21.364298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe345-05b8-4f6f-b5d3-d297fa7b8331 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.421157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:21.428229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:21.444485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6767a3-1759-4769-a105-d7b4cb554d1f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.449936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.450286 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe345-05b8-4f6f-b5d3-d297fa7b8331 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.450996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.451426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.451879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] PATH_INFO: `/v3/users/3043486ffcbd415d9149f1cccb9df61b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.453341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3043486ffcbd415d9149f1cccb9df61b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.455527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.455677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.456136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.456460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.456725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.457847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.459735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.496463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1041/2063] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:21 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:21.501660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.516850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3043486ffcbd415d9149f1cccb9df61b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:21.526241 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3043486ffcbd415d9149f1cccb9df61b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:21.527684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3043486ffcbd415d9149f1cccb9df61b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:21.547501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3043486ffcbd415d9149f1cccb9df61b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:21.558288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-636d705d-ad38-4cba-972b-491eadc928cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3043486ffcbd415d9149f1cccb9df61b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:21.567712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1023/2064] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:21 2022] DELETE /identity/v3/users/3043486ffcbd415d9149f1cccb9df61b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:21.572179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.572787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.573294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.591536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a956e-598d-4021-b2c8-1b51b41dd043 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.607293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:21.608557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:21.680180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.680996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.681390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.681702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.682508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.685893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.700367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1024/2065] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:21.709250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.711302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:21.726133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1042/2066] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:21 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:21.729948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.732720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:21.748458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434f48a-53b9-4e3b-b0ac-e763c1e1ef01 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.762637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.763602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.764068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.764583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.766507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.770513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.786964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1043/2067] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:21.791018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.807636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0561a-7b07-44a3-a838-537b955a9f57 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.818031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20a941-b473-42f7-9738-2e00f1b60823 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.822205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d91d-d735-4662-884d-57e41a9499fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.824405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d91d-d735-4662-884d-57e41a9499fb service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.824585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d91d-d735-4662-884d-57e41a9499fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.824869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d91d-d735-4662-884d-57e41a9499fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.827192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.827822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.828101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.828614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.829272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.830875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.836544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433d91d-d735-4662-884d-57e41a9499fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.838250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433d91d-d735-4662-884d-57e41a9499fb service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.853505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1044/2069] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:21.856356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1025/2069] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:21.860884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:21.874246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63277-1cf2-4221-93c4-be2839609006 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:21.879773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:21.880474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.880754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.881053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] PATH_INFO: `/v3/projects/09d401e3fc0b494abfed489979263712/users/84688bc575df40b4bf57986045cb278e/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.899035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d401e3fc0b494abfed489979263712, user_id=84688bc575df40b4bf57986045cb278e, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:21.901889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:21.916609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1045/2070] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:21 2022] PUT /identity/v3/projects/09d401e3fc0b494abfed489979263712/users/84688bc575df40b4bf57986045cb278e/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:21.927519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:21.927807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:21.928084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:21.958284 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:21.970147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] MFA Rules not processed for user `84688bc575df40b4bf57986045cb278e`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:21.972410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:22.071680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1026/2071] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:22.076303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.104467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:22.148772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3de04-f210-4502-9284-0bf11e5cf9b8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.153837 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.154454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.154737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.155011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.155663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.157615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.183690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.185209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:22.194562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1046/2072] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:22 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:22.195100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.205348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce0c59-4194-4992-b905-b0fdf557842e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.265146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.265898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.266182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.266455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] PATH_INFO: `/v3/projects/87c5d448515248bbb5145ec804c77c6f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.267589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c5d448515248bbb5145ec804c77c6f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.269561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.270280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29ed9-431b-4f18-b6d2-e62e9b3154e6 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.274999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.275629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.275913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.276187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.276874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.278779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.302749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1047/2073] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:22 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:22.306902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.316410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bf549-f12c-43af-b18a-e8d7668a5119 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.319915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c5d448515248bbb5145ec804c77c6f', 'request_id': 'req-8a58b3cc-95fb-44a6-b246-06133656efe2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.327564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c5d448515248bbb5145ec804c77c6f', 'request_id': 'req-8a58b3cc-95fb-44a6-b246-06133656efe2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.335165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c5d448515248bbb5145ec804c77c6f', 'request_id': 'req-8a58b3cc-95fb-44a6-b246-06133656efe2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.348701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] The token cache is being invalidate because project 87c5d448515248bbb5145ec804c77c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:22.348996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.349664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.351176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1027/2074] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:22 2022] DELETE /identity/v3/projects/87c5d448515248bbb5145ec804c77c6f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:22.355124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.356599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:22.387502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.388480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.388772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.389185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.389850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.391445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:22.391572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.406253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1048/2075] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:22.410602 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.413996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:22.427552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8c79a-e392-4e04-b82e-2060ec3b714d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.432471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58b3cc-95fb-44a6-b246-06133656efe2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.432597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.433218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.433815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.433815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] PATH_INFO: `/v3/projects/0de99116600e4f988b1bbf5e5f5b234b/users/b6eab731e7cc4af48018e62b07e581ba/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.438292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.438532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.438785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.439195 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] PATH_INFO: `/v3/users/dbced633ef2d412cb67112d94d492263` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.440636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbced633ef2d412cb67112d94d492263)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.443283 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.453313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de99116600e4f988b1bbf5e5f5b234b, user_id=b6eab731e7cc4af48018e62b07e581ba, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.456610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.473238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1049/2076] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:22 2022] PUT /identity/v3/projects/0de99116600e4f988b1bbf5e5f5b234b/users/b6eab731e7cc4af48018e62b07e581ba/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:22.477833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.491147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:22.502862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbced633ef2d412cb67112d94d492263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.510680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbced633ef2d412cb67112d94d492263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.511396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbced633ef2d412cb67112d94d492263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.528874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbced633ef2d412cb67112d94d492263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.536651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbced633ef2d412cb67112d94d492263'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:22.542926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1028/2077] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:22 2022] DELETE /identity/v3/users/dbced633ef2d412cb67112d94d492263 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:22.550279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5716-1825-4bf3-8b92-df66b5009dad admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.609997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2c097-d803-45be-b178-bb30476e4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.610619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2c097-d803-45be-b178-bb30476e4e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.610899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2c097-d803-45be-b178-bb30476e4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.611173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2c097-d803-45be-b178-bb30476e4e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.611823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2c097-d803-45be-b178-bb30476e4e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.613487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2c097-d803-45be-b178-bb30476e4e2a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.624343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1050/2078] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:22.630263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.631835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:22.647864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8fe55-150e-4b44-8381-f25ea2ea5a3d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.652665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.653319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.653599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.653871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] PATH_INFO: `/v3/projects/0de99116600e4f988b1bbf5e5f5b234b/users/b6eab731e7cc4af48018e62b07e581ba/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.655766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de99116600e4f988b1bbf5e5f5b234b, user_id=b6eab731e7cc4af48018e62b07e581ba, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.658463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.668780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1029/2079] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:22 2022] PUT /identity/v3/projects/0de99116600e4f988b1bbf5e5f5b234b/users/b6eab731e7cc4af48018e62b07e581ba/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:22.678854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.679514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.679514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.709003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] MFA Rules not processed for user `b6eab731e7cc4af48018e62b07e581ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:22.710374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:22.783806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1051/2080] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:22.795927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.797689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:22.895385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b15cd4-f362-4533-8483-12730d91b0a6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:22.900769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:22.901708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:22.902266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:22.902550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:22.917237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:22.919009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:22.933331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1030/2081] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:22.989185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:22.990706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:23.005509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7191f1-874f-49a7-b158-a969407e8be4 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.009220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba16eb-85e0-40f8-b1c9-055a75896380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.009824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba16eb-85e0-40f8-b1c9-055a75896380 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.010236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba16eb-85e0-40f8-b1c9-055a75896380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.010513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba16eb-85e0-40f8-b1c9-055a75896380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.012715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-76ba16eb-85e0-40f8-b1c9-055a75896380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:23.069836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:23.132415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:23.134603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:23.151923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba16eb-85e0-40f8-b1c9-055a75896380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.153794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba16eb-85e0-40f8-b1c9-055a75896380 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.173450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1052/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:23.202447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:23.230172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63d0e-a4f0-49ca-b840-9023dbe14e7f service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.236601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.236720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.237046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.237179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] PATH_INFO: `/v3/projects/d1f34fa9c7484eba8178d135b88e8746` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.238352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f34fa9c7484eba8178d135b88e8746)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.241047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.291042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f34fa9c7484eba8178d135b88e8746', 'request_id': 'req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:23.297796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f34fa9c7484eba8178d135b88e8746', 'request_id': 'req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:23.306044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f34fa9c7484eba8178d135b88e8746', 'request_id': 'req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:23.321358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] The token cache is being invalidate because project d1f34fa9c7484eba8178d135b88e8746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:23.321823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:23.322657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-47b4f7e8-f6e3-4c4b-9a6a-0b4904de810c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:23.324509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1031/2083] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:23 2022] DELETE /identity/v3/projects/d1f34fa9c7484eba8178d135b88e8746 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:23.337880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367870-e87c-40a2-8a57-85a1ed04a66d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.338159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367870-e87c-40a2-8a57-85a1ed04a66d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.338445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367870-e87c-40a2-8a57-85a1ed04a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.359440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-21367870-e87c-40a2-8a57-85a1ed04a66d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:23.360719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-21367870-e87c-40a2-8a57-85a1ed04a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:23.425503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1053/2084] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:23.435305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5271-2679-4720-ba70-03c1db1852fa None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.435590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5271-2679-4720-ba70-03c1db1852fa None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.435862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5271-2679-4720-ba70-03c1db1852fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.455861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-494f5271-2679-4720-ba70-03c1db1852fa None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:23.457248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-494f5271-2679-4720-ba70-03c1db1852fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:23.466468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1032/2085] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:23.470425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21367870-e87c-40a2-8a57-85a1ed04a66d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:23.494365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21367870-e87c-40a2-8a57-85a1ed04a66d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.499976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.500958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.501520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.502071 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.502986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:23.503518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.505374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.524330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1054/2086] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:23.527443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f5271-2679-4720-ba70-03c1db1852fa None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:23.538158 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f5271-2679-4720-ba70-03c1db1852fa None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.543337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.543954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.544233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.544538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.545178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.547437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.587278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1033/2087] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:23 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:23.592316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:23.603580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af0a41-d152-443d-84c0-b2a2f986f7e4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.665240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.665848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.666130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.666396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.667037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.669008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.695319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1055/2088] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:23 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:23.697157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:23.707533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd4370-d3ff-404d-bafd-08d1fc17a227 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.712773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.713369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.713645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.713919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.714556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.716312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.726656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1034/2089] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:23.730687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:23.741579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893457-f1d5-4f1f-aecc-a6a7601422c8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.746561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7401b4-de84-41cb-b9e9-9cc3ea84f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.747651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7401b4-de84-41cb-b9e9-9cc3ea84f856 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.747939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7401b4-de84-41cb-b9e9-9cc3ea84f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.748219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7401b4-de84-41cb-b9e9-9cc3ea84f856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.748912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7401b4-de84-41cb-b9e9-9cc3ea84f856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.750806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7401b4-de84-41cb-b9e9-9cc3ea84f856 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.762274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1056/2090] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:23.766506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:23.776724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf806b-ad72-4719-976e-7a7e3a78db45 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:23.781505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:23.782182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.782752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.782752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] PATH_INFO: `/v3/projects/a5ff60be0cfa4d409e685828e2f9ba43/users/670506c9c41140a0b2c2f6965f0f45d2/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.798066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ff60be0cfa4d409e685828e2f9ba43, user_id=670506c9c41140a0b2c2f6965f0f45d2, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:23.801411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:23.814891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1035/2091] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:23 2022] PUT /identity/v3/projects/a5ff60be0cfa4d409e685828e2f9ba43/users/670506c9c41140a0b2c2f6965f0f45d2/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:23.825980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c90cb-6123-415c-87f4-9c1717ad9bac None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:23.826273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c90cb-6123-415c-87f4-9c1717ad9bac None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:23.826567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c90cb-6123-415c-87f4-9c1717ad9bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:23.859684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-645c90cb-6123-415c-87f4-9c1717ad9bac None None] MFA Rules not processed for user `670506c9c41140a0b2c2f6965f0f45d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:23.860930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-645c90cb-6123-415c-87f4-9c1717ad9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:23.896580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:23.934847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1057/2092] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:23.939925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:24.017226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644388-28ff-4f6a-b771-06b3e496a082 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:24.025048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:24.025839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.026122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.026904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.027560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:24.030635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:24.046409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:24.081216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c90cb-6123-415c-87f4-9c1717ad9bac None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:24.091105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1036/2093] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:23 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:24.097295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c90cb-6123-415c-87f4-9c1717ad9bac None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:24.226002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:24.228510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.228776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.229078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.229800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:24.237566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:24.276451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1058/2094] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:24 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:24.277623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:24.291456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45e7c-8678-4243-85e6-5d46a66fe0a5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:24.296539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:24.297151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.297595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.297873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.298560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:24.300182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:24.311485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1037/2095] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:24.315754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:24.326436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c2e52-d0e6-4656-a0a6-a7251d301bb5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:24.334834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:24.335856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.336297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.336709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] PATH_INFO: `/v3/projects/eb2d7763db58466f948273cc14130c13/users/48eb9eb3d7e04ac1b9ca781c269576f9/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.356809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2d7763db58466f948273cc14130c13, user_id=48eb9eb3d7e04ac1b9ca781c269576f9, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:24.359618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:24.376439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1059/2096] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:24 2022] PUT /identity/v3/projects/eb2d7763db58466f948273cc14130c13/users/48eb9eb3d7e04ac1b9ca781c269576f9/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:24.379957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:24.391117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bd858-4180-4cfe-96c4-da8445b27479 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:24.491539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292579e-d68e-47df-8210-30c4d8c94e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:24.491965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292579e-d68e-47df-8210-30c4d8c94e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.492237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292579e-d68e-47df-8210-30c4d8c94e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.492546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292579e-d68e-47df-8210-30c4d8c94e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.493323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292579e-d68e-47df-8210-30c4d8c94e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:24.495095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292579e-d68e-47df-8210-30c4d8c94e8b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:24.506092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1038/2097] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:24.510341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:24.521081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1927b-d9c1-489d-86db-6f359ebd2563 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:24.525759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:24.526416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.526748 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.526962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] PATH_INFO: `/v3/projects/eb2d7763db58466f948273cc14130c13/users/48eb9eb3d7e04ac1b9ca781c269576f9/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.528878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2d7763db58466f948273cc14130c13, user_id=48eb9eb3d7e04ac1b9ca781c269576f9, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:24.531544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:24.547491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1060/2098] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:24 2022] PUT /identity/v3/projects/eb2d7763db58466f948273cc14130c13/users/48eb9eb3d7e04ac1b9ca781c269576f9/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:24.562078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff92e-b1fb-4a4c-83e3-14fcaa623d46 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.562371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff92e-b1fb-4a4c-83e3-14fcaa623d46 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.562724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff92e-b1fb-4a4c-83e3-14fcaa623d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.596459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e81ff92e-b1fb-4a4c-83e3-14fcaa623d46 None None] MFA Rules not processed for user `48eb9eb3d7e04ac1b9ca781c269576f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:24.597667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e81ff92e-b1fb-4a4c-83e3-14fcaa623d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:24.680095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1039/2099] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:24.693838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:24.695573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:24.774084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcf7d2-b21e-4be8-a0a2-f4e0b77ab1c3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:24.777924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19eada-0fb3-4bd5-a2e5-682bb6f4d213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:24.778567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19eada-0fb3-4bd5-a2e5-682bb6f4d213 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:24.778913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19eada-0fb3-4bd5-a2e5-682bb6f4d213 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:24.779263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19eada-0fb3-4bd5-a2e5-682bb6f4d213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:24.788894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19eada-0fb3-4bd5-a2e5-682bb6f4d213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:24.790414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19eada-0fb3-4bd5-a2e5-682bb6f4d213 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:24.802418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1061/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:25.167329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff92e-b1fb-4a4c-83e3-14fcaa623d46 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:25.230317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff92e-b1fb-4a4c-83e3-14fcaa623d46 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:25.236210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:25.236460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:25.237512 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:25.238127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] PATH_INFO: `/v3/users/670506c9c41140a0b2c2f6965f0f45d2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:25.239286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=670506c9c41140a0b2c2f6965f0f45d2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:25.241401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:25.242966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:25.294191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670506c9c41140a0b2c2f6965f0f45d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.302466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670506c9c41140a0b2c2f6965f0f45d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.303267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670506c9c41140a0b2c2f6965f0f45d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.315774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670506c9c41140a0b2c2f6965f0f45d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.322556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670506c9c41140a0b2c2f6965f0f45d2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.328358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1040/2101] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:25 2022] DELETE /identity/v3/users/670506c9c41140a0b2c2f6965f0f45d2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:25.333355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:25.333827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:25.333938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:25.353011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:25.354188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:25.373053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:25.414117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1062/2102] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:25.424242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:25.425678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:25.485460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6534bb0-979d-436d-a151-188da51a9bbc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:25.489886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:25.490723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:25.491146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:25.491561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:25.504499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:25.505973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:25.515331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1041/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:25.851152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:25.852863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:25.872789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8ce3-3e12-4ef7-8046-6ccc53be123d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:25.882211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:25.882882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:25.883158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:25.883429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] PATH_INFO: `/v3/projects/a5ff60be0cfa4d409e685828e2f9ba43` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:25.884868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ff60be0cfa4d409e685828e2f9ba43)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:25.886552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:25.934823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ff60be0cfa4d409e685828e2f9ba43', 'request_id': 'req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.942800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ff60be0cfa4d409e685828e2f9ba43', 'request_id': 'req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.948811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ff60be0cfa4d409e685828e2f9ba43', 'request_id': 'req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.961388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] The token cache is being invalidate because project a5ff60be0cfa4d409e685828e2f9ba43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:25.961681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.962353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:25.963843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1063/2104] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:25 2022] DELETE /identity/v3/projects/a5ff60be0cfa4d409e685828e2f9ba43 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:25.967751 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:25.977555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b9a3d-3199-4c4b-96b5-55bac806624a service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:26.043630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:26.044434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.044716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.044986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] PATH_INFO: `/v3/users/48eb9eb3d7e04ac1b9ca781c269576f9` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.046104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48eb9eb3d7e04ac1b9ca781c269576f9)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:26.048045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:26.073253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:26.100355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48eb9eb3d7e04ac1b9ca781c269576f9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.108123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48eb9eb3d7e04ac1b9ca781c269576f9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.108628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48eb9eb3d7e04ac1b9ca781c269576f9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.121680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48eb9eb3d7e04ac1b9ca781c269576f9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.143869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d03df95f-6696-408b-bbde-3f7058a3b374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48eb9eb3d7e04ac1b9ca781c269576f9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.143869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1042/2105] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:25 2022] DELETE /identity/v3/users/48eb9eb3d7e04ac1b9ca781c269576f9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:26.409144 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:26.411547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:26.425356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3d8e9-97c4-4a19-9fb5-8c59d8650abf admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:26.484696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:26.485427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.485792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.486168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] PATH_INFO: `/v3/projects/eb2d7763db58466f948273cc14130c13` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.487347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2d7763db58466f948273cc14130c13)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:26.490043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:26.542183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2d7763db58466f948273cc14130c13', 'request_id': 'req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.544779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:26.549691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2d7763db58466f948273cc14130c13', 'request_id': 'req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.558128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2d7763db58466f948273cc14130c13', 'request_id': 'req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.570648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] The token cache is being invalidate because project eb2d7763db58466f948273cc14130c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:26.570967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.571623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e46a459b-cb3a-4075-a952-c9eed8d0d3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:26.573173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1064/2106] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:26 2022] DELETE /identity/v3/projects/eb2d7763db58466f948273cc14130c13 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:26.580359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ae12-e9c0-4b1b-a86f-118cf67f55f5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.580852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ae12-e9c0-4b1b-a86f-118cf67f55f5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.580965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ae12-e9c0-4b1b-a86f-118cf67f55f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.603894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cee4ae12-e9c0-4b1b-a86f-118cf67f55f5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:26.605063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cee4ae12-e9c0-4b1b-a86f-118cf67f55f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:26.666017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1043/2107] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:26.673749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f24d-567a-4ffd-8c67-6efecbd98132 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.674043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f24d-567a-4ffd-8c67-6efecbd98132 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.674321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f24d-567a-4ffd-8c67-6efecbd98132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.693814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c837f24d-567a-4ffd-8c67-6efecbd98132 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:26.695045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c837f24d-567a-4ffd-8c67-6efecbd98132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:26.705002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1065/2108] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:26.709731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ae12-e9c0-4b1b-a86f-118cf67f55f5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:26.720197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ae12-e9c0-4b1b-a86f-118cf67f55f5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:26.725770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:26.726380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.726661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.726935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.727587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:26.727891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:26.729534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:26.742678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1044/2109] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:26.746690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837f24d-567a-4ffd-8c67-6efecbd98132 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:26.756408 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837f24d-567a-4ffd-8c67-6efecbd98132 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:26.761968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:26.762578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.762858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.763276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.763913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:26.766021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:26.801940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1066/2110] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:26 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:26.803084 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:26.813451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9c061-498e-42c3-be30-ba2eb85e6420 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:26.879320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:26.879713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.880000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.880302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.880962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:26.882901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:26.908368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1045/2111] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:26 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:26.909505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:26.935118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71539-7c9d-4864-9e16-0d494afc549d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:26.940426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:26.941037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.941992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.942373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.943210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:26.944842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:26.960325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1067/2112] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:26.964584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:26.975764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b3de0-f8c3-4498-8e38-08641fa4d417 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:26.980638 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b00e-3c85-4696-a971-750c4cabba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:26.981242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b00e-3c85-4696-a971-750c4cabba97 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:26.981524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b00e-3c85-4696-a971-750c4cabba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:26.981794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b00e-3c85-4696-a971-750c4cabba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:26.982467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839b00e-3c85-4696-a971-750c4cabba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:26.984050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839b00e-3c85-4696-a971-750c4cabba97 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:26.995540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1046/2113] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:26.999444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:27.015002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec9c9-1147-40b6-856a-ba378a0a37db admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:27.016500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:27.017148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.017429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.017704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] PATH_INFO: `/v3/projects/b78b2596158340c1892414df99c241ff/users/efa46544d7cf415a9089f576af2ad1d8/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.033484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78b2596158340c1892414df99c241ff, user_id=efa46544d7cf415a9089f576af2ad1d8, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:27.036182 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:27.049733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1068/2114] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:26 2022] PUT /identity/v3/projects/b78b2596158340c1892414df99c241ff/users/efa46544d7cf415a9089f576af2ad1d8/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:27.060098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.060563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.060908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.074383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:27.091529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] MFA Rules not processed for user `efa46544d7cf415a9089f576af2ad1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:27.092753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:27.182569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1047/2115] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:27.234777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:27.236851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:27.298959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:27.300240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b3d99-ddfa-4baf-9ffe-9a80039093ce admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:27.300409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:27.303901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:27.304540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.304822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.305096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.313882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:27.315499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:27.325883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1069/2116] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:27.353204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:27.370444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5a70-030f-4025-8e90-8bbe7906aca2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:27.375989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:27.376676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.376962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.377242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] PATH_INFO: `/v3/users/f6af6a00a69d4bcc852270692f4887a2` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.378619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6af6a00a69d4bcc852270692f4887a2)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:27.381310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:27.421147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e27f1-6d60-4ad2-8cdf-f5d08432f8b7 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:27.427352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:27.432679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.432970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.433278 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] PATH_INFO: `/v3/users/efa46544d7cf415a9089f576af2ad1d8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.434607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa46544d7cf415a9089f576af2ad1d8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:27.436665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:27.456779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6af6a00a69d4bcc852270692f4887a2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.460461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:27.465132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6af6a00a69d4bcc852270692f4887a2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.465908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6af6a00a69d4bcc852270692f4887a2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.480546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6af6a00a69d4bcc852270692f4887a2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.487589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3fdef029-59db-4312-b092-09936487f655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6af6a00a69d4bcc852270692f4887a2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.489032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa46544d7cf415a9089f576af2ad1d8'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.494908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1048/2117] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:27 2022] DELETE /identity/v3/users/f6af6a00a69d4bcc852270692f4887a2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:27.497130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa46544d7cf415a9089f576af2ad1d8'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.498130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa46544d7cf415a9089f576af2ad1d8'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.499546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.500145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.500661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.506276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa46544d7cf415a9089f576af2ad1d8'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.519351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4f2968a-b9e6-44aa-9417-e3be054d46e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa46544d7cf415a9089f576af2ad1d8'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:27.520547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:27.521761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:27.526166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1070/2118] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:27 2022] DELETE /identity/v3/users/efa46544d7cf415a9089f576af2ad1d8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:27.530343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.530634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.530916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.534145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:27.550496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:27.552233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:27.592973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1049/2119] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:27.610480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:27.612370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:27.623554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1071/2120] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:27.630634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:27.632068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:27.677929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d0cbf-00c9-4d1e-845f-7d9e2820dbd1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:27.696661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aac7e-a9bf-4888-9132-9ee17f810042 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:27.700513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:27.701149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.701433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.701707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.711109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:27.712609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:27.722006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1072/2121] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:27.726393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:27.727007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:27.727308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:27.727584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:27.736861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:27.738943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:27.748571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1050/2122] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:28.197622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:28.199610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:28.203832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:28.206442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:28.221118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee947b15-a654-472d-b90a-98933e638741 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:28.226737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:28.227372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:28.227679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:28.227976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] PATH_INFO: `/v3/projects/679ca51e4c9c408ba8d5c4ec21f633b9` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:28.229133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679ca51e4c9c408ba8d5c4ec21f633b9)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:28.231039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:28.248030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59c85-3749-4d88-8c5f-1784ef12b52d service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:28.253890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:28.254636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:28.255019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:28.255398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] PATH_INFO: `/v3/projects/b78b2596158340c1892414df99c241ff` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:28.256999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78b2596158340c1892414df99c241ff)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:28.260169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:28.281418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:28.301494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679ca51e4c9c408ba8d5c4ec21f633b9', 'request_id': 'req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.313029 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679ca51e4c9c408ba8d5c4ec21f633b9', 'request_id': 'req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.319327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679ca51e4c9c408ba8d5c4ec21f633b9', 'request_id': 'req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.320879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78b2596158340c1892414df99c241ff', 'request_id': 'req-dc927ffc-b3d2-4501-a33d-f26018636269'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.334662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] The token cache is being invalidate because project 679ca51e4c9c408ba8d5c4ec21f633b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:28.335037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.335687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.337198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78b2596158340c1892414df99c241ff', 'request_id': 'req-dc927ffc-b3d2-4501-a33d-f26018636269'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.338702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1073/2123] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:28 2022] DELETE /identity/v3/projects/679ca51e4c9c408ba8d5c4ec21f633b9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:28.344132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:28.345515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78b2596158340c1892414df99c241ff', 'request_id': 'req-dc927ffc-b3d2-4501-a33d-f26018636269'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.350061 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:28.363256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:28.377901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] The token cache is being invalidate because project b78b2596158340c1892414df99c241ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:28.378327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.379143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.381885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1051/2124] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:28 2022] DELETE /identity/v3/projects/b78b2596158340c1892414df99c241ff => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:28.516266 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50c8c-2acd-4a9b-a0ac-7c4da7f37853 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:28.636040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:28.636757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:28.637041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:28.637449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] PATH_INFO: `/v3/users/84688bc575df40b4bf57986045cb278e` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:28.639697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84688bc575df40b4bf57986045cb278e)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:28.642229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:28.706607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84688bc575df40b4bf57986045cb278e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.715802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84688bc575df40b4bf57986045cb278e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.716403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84688bc575df40b4bf57986045cb278e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.724054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84688bc575df40b4bf57986045cb278e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.732126 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:28.740149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84688bc575df40b4bf57986045cb278e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:28.747377 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1074/2125] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:28 2022] DELETE /identity/v3/users/84688bc575df40b4bf57986045cb278e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:29.280295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:29.281988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:29.298260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc927ffc-b3d2-4501-a33d-f26018636269 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:29.379508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:29.380204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:29.381019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:29.381301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] PATH_INFO: `/v3/projects/09d401e3fc0b494abfed489979263712` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:29.382424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d401e3fc0b494abfed489979263712)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:29.384364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:29.432096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d401e3fc0b494abfed489979263712', 'request_id': 'req-e217a1ba-534a-404a-a488-c5e4369c5177'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.437603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d401e3fc0b494abfed489979263712', 'request_id': 'req-e217a1ba-534a-404a-a488-c5e4369c5177'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.443977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d401e3fc0b494abfed489979263712', 'request_id': 'req-e217a1ba-534a-404a-a488-c5e4369c5177'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.457176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] The token cache is being invalidate because project 09d401e3fc0b494abfed489979263712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:29.457460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.458153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.459990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1052/2126] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:29 2022] DELETE /identity/v3/projects/09d401e3fc0b494abfed489979263712 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:29.463760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:29.465378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:29.478635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1bf4-0545-40be-8374-4551ffcc553c admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:29.535851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:29.536516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:29.536792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:29.537069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] PATH_INFO: `/v3/users/b6eab731e7cc4af48018e62b07e581ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:29.538204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6eab731e7cc4af48018e62b07e581ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:29.540128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:29.589289 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6eab731e7cc4af48018e62b07e581ba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.601771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6eab731e7cc4af48018e62b07e581ba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.602387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6eab731e7cc4af48018e62b07e581ba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.609829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6eab731e7cc4af48018e62b07e581ba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.623534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-95fe0037-f61d-4696-9a0a-ab26598db5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6eab731e7cc4af48018e62b07e581ba'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:29.631211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1075/2127] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:29 2022] DELETE /identity/v3/users/b6eab731e7cc4af48018e62b07e581ba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:29.962133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:29.963768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:29.980307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a1ba-534a-404a-a488-c5e4369c5177 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.051117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.051785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.052118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.052462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] PATH_INFO: `/v3/projects/0de99116600e4f988b1bbf5e5f5b234b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.053859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de99116600e4f988b1bbf5e5f5b234b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.056295 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.094015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:30.111094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de99116600e4f988b1bbf5e5f5b234b', 'request_id': 'req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:30.116721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de99116600e4f988b1bbf5e5f5b234b', 'request_id': 'req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:30.122854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de99116600e4f988b1bbf5e5f5b234b', 'request_id': 'req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:30.136477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] The token cache is being invalidate because project 0de99116600e4f988b1bbf5e5f5b234b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:30.136763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:30.137389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e2bafce4-adf8-4c4b-a49d-2a12916e79a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:30.139072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1053/2128] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:29 2022] DELETE /identity/v3/projects/0de99116600e4f988b1bbf5e5f5b234b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:30.145735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.146022 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.146298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.172800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:30.174227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:30.260169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1076/2129] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:30.268829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073181d8-db00-4edf-81c0-88b43e9a2483 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.269341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073181d8-db00-4edf-81c0-88b43e9a2483 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.270398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073181d8-db00-4edf-81c0-88b43e9a2483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.293533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-073181d8-db00-4edf-81c0-88b43e9a2483 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:30.295278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-073181d8-db00-4edf-81c0-88b43e9a2483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:30.295974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:30.297658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:30.305068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1054/2130] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:30.310173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073181d8-db00-4edf-81c0-88b43e9a2483 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:30.315677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:30.322515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073181d8-db00-4edf-81c0-88b43e9a2483 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.328544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.330322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.330705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.331078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.332543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:30.332855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.335083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.357034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1055/2131] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:29:30.359701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:30.374367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107f16a-b3b8-4502-b719-56a9f4e8485c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.381409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.382516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.382872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.383480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.384099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd939-d1d3-46ec-9b4f-c2d795a20d1e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.384411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.387309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.388665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.389498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.390093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.390517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.392842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:30.428343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1056/2132] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:30 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:30.434800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:30.490441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.492102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.506659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1077/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:30.522637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b61b2-e85f-4cb9-801a-45d3c9d7e2f5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.530485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.531236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.531626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.532099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.532903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.536193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.573124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1057/2134] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:30 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:30.577603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:30.592129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5806e-482a-40fe-a87b-472d72764e75 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.609507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.610226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.610590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.610915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.611638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.613899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.633477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1078/2135] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:30.635660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:30.648515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f49f-f0f8-4639-bab8-c910d95a6308 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.654078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01895d-0aa6-4524-9093-5335adeb0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.654812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01895d-0aa6-4524-9093-5335adeb0c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.655198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01895d-0aa6-4524-9093-5335adeb0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.655575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01895d-0aa6-4524-9093-5335adeb0c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.656510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01895d-0aa6-4524-9093-5335adeb0c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.661082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01895d-0aa6-4524-9093-5335adeb0c90 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.677268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1058/2136] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:30.681181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:30.694415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ea92-9376-47fd-b106-5fcd0d0efe27 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:30.699663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:30.700642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.701053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.701648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] PATH_INFO: `/v3/projects/3ec0d20a091047d1abd5df87c85014f1/users/995e703f240b4fea8a3d3bccd82b9479/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.749810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec0d20a091047d1abd5df87c85014f1, user_id=995e703f240b4fea8a3d3bccd82b9479, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:30.752630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:30.780028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1079/2137] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:30 2022] PUT /identity/v3/projects/3ec0d20a091047d1abd5df87c85014f1/users/995e703f240b4fea8a3d3bccd82b9479/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:30.793585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b14a-56f9-446b-965b-7597653142ae None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:30.793900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b14a-56f9-446b-965b-7597653142ae None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:30.794168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b14a-56f9-446b-965b-7597653142ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:30.846576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6550b14a-56f9-446b-965b-7597653142ae None None] MFA Rules not processed for user `995e703f240b4fea8a3d3bccd82b9479`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:30.848726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6550b14a-56f9-446b-965b-7597653142ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:30.915885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:30.962230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1059/2138] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:30.963738 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:31.071419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05571e0c-5b9b-4fbb-8ac2-b2151bf3ea6d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:31.083935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:31.089433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.089732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.090010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.090740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:31.092780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:31.124961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1080/2139] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:30 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:31.139066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b14a-56f9-446b-965b-7597653142ae None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:31.166153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b14a-56f9-446b-965b-7597653142ae None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:31.248939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:31.250098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.250371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.250703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.251584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:31.253683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:31.283216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1060/2140] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:31 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:31.288585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:31.300363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99efb9-ed5b-449c-a937-b527a7574fea admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:31.305026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:31.305628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.305908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.306177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.306818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:31.308925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:31.314213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:31.324445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1081/2141] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:31.325558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:31.336643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83310-6d92-45eb-9e60-871ea11874e5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:31.341663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:31.342347 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.342624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.342894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] PATH_INFO: `/v3/projects/d034196b12fa4ddba38f1ff06aee4676/users/2a95d70115c441d2a583c051a947cfa7/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.362655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d034196b12fa4ddba38f1ff06aee4676, user_id=2a95d70115c441d2a583c051a947cfa7, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:31.365429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:31.381164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1061/2142] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:31 2022] PUT /identity/v3/projects/d034196b12fa4ddba38f1ff06aee4676/users/2a95d70115c441d2a583c051a947cfa7/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:31.385125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:31.400865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee2c5-2e82-4589-b151-c330af76bfc4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:31.493225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc6e39-a444-4757-8975-3445f02c77ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:31.494189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6e39-a444-4757-8975-3445f02c77ab admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.494619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6e39-a444-4757-8975-3445f02c77ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.495041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6e39-a444-4757-8975-3445f02c77ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.495862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc6e39-a444-4757-8975-3445f02c77ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:31.497798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc6e39-a444-4757-8975-3445f02c77ab admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:31.508904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1082/2143] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:31.513243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:31.526240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d6cea-aacf-4187-b752-d2e549bbd46f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:31.533875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:31.535436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.535912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.536256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] PATH_INFO: `/v3/projects/d034196b12fa4ddba38f1ff06aee4676/users/2a95d70115c441d2a583c051a947cfa7/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.538381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d034196b12fa4ddba38f1ff06aee4676, user_id=2a95d70115c441d2a583c051a947cfa7, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:31.541430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:31.554528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1062/2144] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:31 2022] PUT /identity/v3/projects/d034196b12fa4ddba38f1ff06aee4676/users/2a95d70115c441d2a583c051a947cfa7/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:31.564677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c771-0097-4508-a048-167b4286ba8e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.564990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c771-0097-4508-a048-167b4286ba8e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.565507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c771-0097-4508-a048-167b4286ba8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.609858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e285c771-0097-4508-a048-167b4286ba8e None None] MFA Rules not processed for user `2a95d70115c441d2a583c051a947cfa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:31.611161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e285c771-0097-4508-a048-167b4286ba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:31.717880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1083/2145] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:31.730392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:31.732197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:31.802937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01319bda-fde1-4864-8dec-bc432131eda0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:31.806732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb992-b9f1-440c-ad6f-0bf755721dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:31.807427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb992-b9f1-440c-ad6f-0bf755721dfa service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:31.807781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb992-b9f1-440c-ad6f-0bf755721dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:31.808128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb992-b9f1-440c-ad6f-0bf755721dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:31.879781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:31.896067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb992-b9f1-440c-ad6f-0bf755721dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:31.897624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb992-b9f1-440c-ad6f-0bf755721dfa service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:31.907533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1063/2146] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:32.767609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb8d0e-b9f0-4db4-aad6-3d838729ad02 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:32.768117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb8d0e-b9f0-4db4-aad6-3d838729ad02 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:32.768206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb8d0e-b9f0-4db4-aad6-3d838729ad02 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:32.769599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1084/2147] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:29:32.796913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073636-bc00-4af5-a2c0-3db59f4bdf84 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:32.797392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073636-bc00-4af5-a2c0-3db59f4bdf84 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:32.797633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073636-bc00-4af5-a2c0-3db59f4bdf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:32.818936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-15073636-bc00-4af5-a2c0-3db59f4bdf84 None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:32.820136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-15073636-bc00-4af5-a2c0-3db59f4bdf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:32.833476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb8d0e-b9f0-4db4-aad6-3d838729ad02 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:32.836231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0dfb8d0e-b9f0-4db4-aad6-3d838729ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:32.938179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1064/2148] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:29:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:32.949236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb8d0e-b9f0-4db4-aad6-3d838729ad02 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:32.950261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b8d0-897a-40e3-9a43-962b650793b6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:32.950550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b8d0-897a-40e3-9a43-962b650793b6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:32.950823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b8d0-897a-40e3-9a43-962b650793b6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:32.952382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1065/2149] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 21 05:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 05:29:32.954464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:32.955216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:32.955499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:32.956078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] PATH_INFO: `/v3/users/b5955d88bb4b435fb0540698858b45a5` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:32.957017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5955d88bb4b435fb0540698858b45a5)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:32.957193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e971a-d6d2-4a1a-a778-bb9a293b182f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:32.957442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e971a-d6d2-4a1a-a778-bb9a293b182f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:32.957706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e971a-d6d2-4a1a-a778-bb9a293b182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:32.959101 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:32.989900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:32.993822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-302e971a-d6d2-4a1a-a778-bb9a293b182f None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:32.995706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-302e971a-d6d2-4a1a-a778-bb9a293b182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:33.013280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1066/2150] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 21 05:29:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:33.021147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e971a-d6d2-4a1a-a778-bb9a293b182f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.022125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5955d88bb4b435fb0540698858b45a5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.032503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5955d88bb4b435fb0540698858b45a5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.032834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5955d88bb4b435fb0540698858b45a5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.042618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e971a-d6d2-4a1a-a778-bb9a293b182f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.044166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5955d88bb4b435fb0540698858b45a5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.049906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f52d9c-e3c2-43cc-9b7b-e4c6f0f68fd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.051248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52d9c-e3c2-43cc-9b7b-e4c6f0f68fd1 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.051591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52d9c-e3c2-43cc-9b7b-e4c6f0f68fd1 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.051969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52d9c-e3c2-43cc-9b7b-e4c6f0f68fd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.054696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-53f52d9c-e3c2-43cc-9b7b-e4c6f0f68fd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:33.060050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5955d88bb4b435fb0540698858b45a5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.069729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1085/2151] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:32 2022] DELETE /identity/v3/users/b5955d88bb4b435fb0540698858b45a5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:33.076787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f52d9c-e3c2-43cc-9b7b-e4c6f0f68fd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.078556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f52d9c-e3c2-43cc-9b7b-e4c6f0f68fd1 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.101089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1067/2152] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:33.307035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.309090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:33.392806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea3b00-0f15-4936-b454-2c5d5114bdd9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.397761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.398444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.398719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.398990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] PATH_INFO: `/v3/projects/3e353fd32b744e08913abb7241552234` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.400139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e353fd32b744e08913abb7241552234)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.402069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.459900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e353fd32b744e08913abb7241552234', 'request_id': 'req-496e3f42-87e7-470c-bf82-7b1d300fea37'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.470191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e353fd32b744e08913abb7241552234', 'request_id': 'req-496e3f42-87e7-470c-bf82-7b1d300fea37'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.478587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e353fd32b744e08913abb7241552234', 'request_id': 'req-496e3f42-87e7-470c-bf82-7b1d300fea37'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.493314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] The token cache is being invalidate because project 3e353fd32b744e08913abb7241552234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:33.493833 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.494902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-496e3f42-87e7-470c-bf82-7b1d300fea37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:33.497603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1086/2153] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:33 2022] DELETE /identity/v3/projects/3e353fd32b744e08913abb7241552234 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:33.503448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80b5f-e5f2-49b9-b464-3d642bce4f15 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.503780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80b5f-e5f2-49b9-b464-3d642bce4f15 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.504575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80b5f-e5f2-49b9-b464-3d642bce4f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.527326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bef80b5f-e5f2-49b9-b464-3d642bce4f15 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:33.528543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bef80b5f-e5f2-49b9-b464-3d642bce4f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:33.591549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1068/2154] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:33.600054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464fae-87b3-463e-8d47-d99d8c0a2d7c None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.600367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464fae-87b3-463e-8d47-d99d8c0a2d7c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.600641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464fae-87b3-463e-8d47-d99d8c0a2d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.620210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-26464fae-87b3-463e-8d47-d99d8c0a2d7c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:33.621600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-26464fae-87b3-463e-8d47-d99d8c0a2d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:33.630316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1087/2155] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:33.634511 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef80b5f-e5f2-49b9-b464-3d642bce4f15 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.645551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef80b5f-e5f2-49b9-b464-3d642bce4f15 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.650461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.651063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.651316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.651586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.652233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:33.652555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.654138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.666903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1069/2156] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:33.671344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464fae-87b3-463e-8d47-d99d8c0a2d7c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.680755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464fae-87b3-463e-8d47-d99d8c0a2d7c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.685403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.686031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.686308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.686572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.687213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.689402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.717705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1088/2157] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:33 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:33.721984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.733666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07aab89-87ab-46bc-8c6c-5bb7d103a8e8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.794490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=100 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:33.810609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.811334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.811642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.812008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.812695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.814623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.837057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1070/2158] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:33 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:33.841052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.846474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:33.854442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e559679-6b57-43ba-83a7-e816373cfca7 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.863457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.864180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.864576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.864932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.865665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.867420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.878050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1089/2159] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:33.882508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.892392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7e5c7-3925-46ac-8cea-07a1b8830051 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.897631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20ed3-d2de-4887-8537-8e7608036d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.898228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20ed3-d2de-4887-8537-8e7608036d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.898509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20ed3-d2de-4887-8537-8e7608036d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.898779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20ed3-d2de-4887-8537-8e7608036d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.899425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20ed3-d2de-4887-8537-8e7608036d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.901033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20ed3-d2de-4887-8537-8e7608036d19 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.913303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1071/2160] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:33.916669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:33.926688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88263f-3e9b-4b2f-8782-59cc9213d82c admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:33.931441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:33.932087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.932474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.932751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] PATH_INFO: `/v3/projects/4f0b30bb31bf42e4ab3ed547ab19e598/users/d41aee0a618c4758b19bff27580fe88a/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:33.947512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0b30bb31bf42e4ab3ed547ab19e598, user_id=d41aee0a618c4758b19bff27580fe88a, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:33.951226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:33.963864 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1090/2161] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:33 2022] PUT /identity/v3/projects/4f0b30bb31bf42e4ab3ed547ab19e598/users/d41aee0a618c4758b19bff27580fe88a/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:29:33.973933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99cb76-ee07-4ef6-aa4f-3556bea4feb3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:33.974147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99cb76-ee07-4ef6-aa4f-3556bea4feb3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:33.974421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99cb76-ee07-4ef6-aa4f-3556bea4feb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.001453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fd99cb76-ee07-4ef6-aa4f-3556bea4feb3 None None] MFA Rules not processed for user `d41aee0a618c4758b19bff27580fe88a`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:34.002671 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fd99cb76-ee07-4ef6-aa4f-3556bea4feb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:34.065535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1072/2162] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:34.070214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.130921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2960-2932-4bbe-8eed-d3329b81329a admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.135463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.136064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.136368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.136642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.137270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.139170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.164877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1091/2163] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:34 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:29:34.169075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99cb76-ee07-4ef6-aa4f-3556bea4feb3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.179953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99cb76-ee07-4ef6-aa4f-3556bea4feb3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.234423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.234997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.235280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.235551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.236182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.238656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.262697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1073/2164] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:34 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:34.266986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.279357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b27c-6af1-45d5-b585-28e895e91cda admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.288109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.288641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.288996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.289407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.290558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.292321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.305333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1092/2165] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:34.309592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.321928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8d6c-85c2-4a1f-92e9-775c05cea312 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.327090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.327842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.328193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.328594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] PATH_INFO: `/v3/projects/229de598c34743799fbcbf78e063c811/users/1db5e329ed7244678d92c855df4a153b/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.344510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229de598c34743799fbcbf78e063c811, user_id=1db5e329ed7244678d92c855df4a153b, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.347430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.365513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1074/2166] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:34 2022] PUT /identity/v3/projects/229de598c34743799fbcbf78e063c811/users/1db5e329ed7244678d92c855df4a153b/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:34.370263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.381501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc580167-6ac7-42a9-8ec7-86cca2d726eb admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.449506 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f14a3-653a-4238-b34a-4bf08b09702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.450222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f14a3-653a-4238-b34a-4bf08b09702f admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.450632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f14a3-653a-4238-b34a-4bf08b09702f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.451059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f14a3-653a-4238-b34a-4bf08b09702f admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.451922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f14a3-653a-4238-b34a-4bf08b09702f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.454289 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f14a3-653a-4238-b34a-4bf08b09702f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.469845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1093/2167] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:34.473898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.485130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee46898-1be1-42fc-ab26-4ccf32b13067 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.490630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.491364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.492004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.492112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] PATH_INFO: `/v3/projects/229de598c34743799fbcbf78e063c811/users/1db5e329ed7244678d92c855df4a153b/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.494890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229de598c34743799fbcbf78e063c811, user_id=1db5e329ed7244678d92c855df4a153b, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.497647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.509599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1075/2168] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:34 2022] PUT /identity/v3/projects/229de598c34743799fbcbf78e063c811/users/1db5e329ed7244678d92c855df4a153b/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:34.521362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.521667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.521977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.556477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] MFA Rules not processed for user `1db5e329ed7244678d92c855df4a153b`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:34.557973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:34.589490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:34.667163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1094/2169] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:34.677951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.680808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:34.704191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:34.747934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9708b4-925c-4063-babb-f07a722d4f48 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.752935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.753599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.753882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.754170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.764344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.765936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.786684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1076/2170] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:34.889583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:34.891109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:34.905199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd082715-d9ca-4eec-a980-d73541981b81 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:34.908847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:34.909608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:34.910478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:34.910755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:34.987875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:34.989379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:34.999419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1095/2171] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:36.400750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:36.410599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12406c-fa36-460d-b48d-c47cf16c41a6 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:36.414262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d96077-4cc4-4d85-aef0-10e5facf8228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:36.414883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d96077-4cc4-4d85-aef0-10e5facf8228 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:36.415165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d96077-4cc4-4d85-aef0-10e5facf8228 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:36.415439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d96077-4cc4-4d85-aef0-10e5facf8228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:36.417575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a4d96077-4cc4-4d85-aef0-10e5facf8228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:36.496048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d96077-4cc4-4d85-aef0-10e5facf8228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:36.497532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d96077-4cc4-4d85-aef0-10e5facf8228 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:36.508312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1077/2172] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:42.463168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:42.464712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:42.528107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d992ca-fc44-4eb1-a6f5-3b876477a368 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:42.532576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:42.533186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:42.533460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:42.533728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] PATH_INFO: `/v3/users/995e703f240b4fea8a3d3bccd82b9479` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:42.534832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995e703f240b4fea8a3d3bccd82b9479)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:42.536757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:42.582910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995e703f240b4fea8a3d3bccd82b9479'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:42.590375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995e703f240b4fea8a3d3bccd82b9479'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:42.590964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995e703f240b4fea8a3d3bccd82b9479'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:42.598665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995e703f240b4fea8a3d3bccd82b9479'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:42.599750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:42.612598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995e703f240b4fea8a3d3bccd82b9479'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:42.618420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1096/2173] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:42 2022] DELETE /identity/v3/users/995e703f240b4fea8a3d3bccd82b9479 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:42.623106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:42.623560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:42.623670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:42.643500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:42.645288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:42.702715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1078/2174] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:42.713175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:42.714564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:42.772628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706866d3-fb72-4cd7-b58e-b181dd21c7d2 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:42.776481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:42.777093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:42.777375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:42.777775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:42.791790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:42.793381 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:42.804547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1097/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:42.869285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:42.871267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:42.895136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf67f8-1d28-4ec0-abde-2777ec81e207 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:42.906345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:42.908557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:42.908921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:42.913790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] PATH_INFO: `/v3/users/798ab8efa3be4caf822ffd87604181d1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:42.915325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798ab8efa3be4caf822ffd87604181d1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:42.917638 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:42.994301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:42.995940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.011415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798ab8efa3be4caf822ffd87604181d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.011657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4861ce9-56d3-4e2b-bef8-e5ecab31a010 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:43.013390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:43.017715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:43.018503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.018834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.019741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] PATH_INFO: `/v3/users/d41aee0a618c4758b19bff27580fe88a` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.021387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41aee0a618c4758b19bff27580fe88a)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:43.022134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798ab8efa3be4caf822ffd87604181d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.023336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798ab8efa3be4caf822ffd87604181d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.023608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:43.038794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798ab8efa3be4caf822ffd87604181d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.047986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ce433afd-744d-4097-b8a3-5370e96755c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798ab8efa3be4caf822ffd87604181d1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.062897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1079/2176] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:42 2022] DELETE /identity/v3/users/798ab8efa3be4caf822ffd87604181d1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:43.066200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.066530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.066828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.090652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:43.091925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.098152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41aee0a618c4758b19bff27580fe88a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.108610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41aee0a618c4758b19bff27580fe88a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.109573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41aee0a618c4758b19bff27580fe88a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.120245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41aee0a618c4758b19bff27580fe88a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.134915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d009f757-efa1-4f72-9048-b5b8c220a1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41aee0a618c4758b19bff27580fe88a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.143077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1098/2177] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:42 2022] DELETE /identity/v3/users/d41aee0a618c4758b19bff27580fe88a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:43.148140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.148482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.148744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.171976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:43.173954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.201377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1080/2178] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:43.201377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:43.201377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.221238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e75c4-772f-4a21-afb8-cfbdf90c2a9a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:43.249229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:43.275181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1099/2179] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:43.277416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:43.279695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.292118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:43.293196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.293481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.293753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] PATH_INFO: `/v3/projects/3ec0d20a091047d1abd5df87c85014f1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.295043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec0d20a091047d1abd5df87c85014f1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:43.297027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:43.346529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613a1da-583e-44af-bd62-42b425befc29 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:43.349995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec0d20a091047d1abd5df87c85014f1', 'request_id': 'req-2f3994de-8025-417e-8770-e08acaa10344'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.355768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec0d20a091047d1abd5df87c85014f1', 'request_id': 'req-2f3994de-8025-417e-8770-e08acaa10344'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.363055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec0d20a091047d1abd5df87c85014f1', 'request_id': 'req-2f3994de-8025-417e-8770-e08acaa10344'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.366813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:43.377863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] The token cache is being invalidate because project 3ec0d20a091047d1abd5df87c85014f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:43.379394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.380054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.383436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1081/2180] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:43 2022] DELETE /identity/v3/projects/3ec0d20a091047d1abd5df87c85014f1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:43.385122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:43.386581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.402265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:43.402880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.403157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.403430 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.405220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.449316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3994de-8025-417e-8770-e08acaa10344 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:43.454569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:43.455503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.455937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.456424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.458441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.472791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:43.474219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:43.483631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1100/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:43.484524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:43.485789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.497773 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03e47-3a72-4b96-94fb-ba39dc26fa0b service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:43.503021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:43.503972 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.504255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.504554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] PATH_INFO: `/v3/users/2a95d70115c441d2a583c051a947cfa7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.505695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a95d70115c441d2a583c051a947cfa7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:43.507624 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:43.532878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:43.535360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:43.549883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1082/2182] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:43.563587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a95d70115c441d2a583c051a947cfa7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.570562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a95d70115c441d2a583c051a947cfa7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.571337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a95d70115c441d2a583c051a947cfa7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.573614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:43.580775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a95d70115c441d2a583c051a947cfa7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.595707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a95d70115c441d2a583c051a947cfa7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:43.603139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1101/2183] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:43 2022] DELETE /identity/v3/users/2a95d70115c441d2a583c051a947cfa7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:43.888861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:43.890582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:43.911131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9736-aeb3-45a0-8ff5-499a907f15b6 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:43.988478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:43.989475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:43.990014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:43.990230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] PATH_INFO: `/v3/projects/710bddfbb2a24fa8be5ecf7be80e4f46` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:43.991750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710bddfbb2a24fa8be5ecf7be80e4f46)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:43.993793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:43.999908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.002990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.024860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858a9f0-f946-4541-93be-68db397eca14 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.032826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.035369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.035803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.036379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] PATH_INFO: `/v3/projects/d034196b12fa4ddba38f1ff06aee4676` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.037812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d034196b12fa4ddba38f1ff06aee4676)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.040935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.064454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:44.068666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710bddfbb2a24fa8be5ecf7be80e4f46', 'request_id': 'req-80f9aef3-1506-426c-be2e-c72332e895e9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.087258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710bddfbb2a24fa8be5ecf7be80e4f46', 'request_id': 'req-80f9aef3-1506-426c-be2e-c72332e895e9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.100753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710bddfbb2a24fa8be5ecf7be80e4f46', 'request_id': 'req-80f9aef3-1506-426c-be2e-c72332e895e9'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.114980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd034196b12fa4ddba38f1ff06aee4676', 'request_id': 'req-d35d55e5-2c7b-493b-90ad-eec8b4a65371'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.115480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] The token cache is being invalidate because project 710bddfbb2a24fa8be5ecf7be80e4f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:44.115769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.116442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.121345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1083/2184] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:43 2022] DELETE /identity/v3/projects/710bddfbb2a24fa8be5ecf7be80e4f46 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:44.121345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.121345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.126821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd034196b12fa4ddba38f1ff06aee4676', 'request_id': 'req-d35d55e5-2c7b-493b-90ad-eec8b4a65371'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.133961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd034196b12fa4ddba38f1ff06aee4676', 'request_id': 'req-d35d55e5-2c7b-493b-90ad-eec8b4a65371'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.146450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] The token cache is being invalidate because project d034196b12fa4ddba38f1ff06aee4676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:44.146851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.147579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d35d55e5-2c7b-493b-90ad-eec8b4a65371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.149172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1102/2185] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:43 2022] DELETE /identity/v3/projects/d034196b12fa4ddba38f1ff06aee4676 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:44.150446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c82c5-75f1-4eab-a9e4-81ad32d86067 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.150783 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c82c5-75f1-4eab-a9e4-81ad32d86067 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.150996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c82c5-75f1-4eab-a9e4-81ad32d86067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.172160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-746c82c5-75f1-4eab-a9e4-81ad32d86067 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:44.173474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-746c82c5-75f1-4eab-a9e4-81ad32d86067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.194521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9aef3-1506-426c-be2e-c72332e895e9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.235233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1103/2186] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:44.236540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc368-7b08-4c86-913c-d49be6c37839 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.236827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc368-7b08-4c86-913c-d49be6c37839 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.237100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc368-7b08-4c86-913c-d49be6c37839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.257062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-afabc368-7b08-4c86-913c-d49be6c37839 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:44.258319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-afabc368-7b08-4c86-913c-d49be6c37839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.261914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.262555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.262840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.263119 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] PATH_INFO: `/v3/projects/4f0b30bb31bf42e4ab3ed547ab19e598` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.264234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0b30bb31bf42e4ab3ed547ab19e598)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.266194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.266351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1104/2187] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:44.267539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e394-4e42-433e-a451-b18c0d4091f4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.267825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e394-4e42-433e-a451-b18c0d4091f4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.268098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e394-4e42-433e-a451-b18c0d4091f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.287694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-02c5e394-4e42-433e-a451-b18c0d4091f4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:44.288941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-02c5e394-4e42-433e-a451-b18c0d4091f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.297010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1105/2188] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:44.300986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.300986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.300986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.319805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:44.321057 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.324071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0b30bb31bf42e4ab3ed547ab19e598', 'request_id': 'req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.330926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0b30bb31bf42e4ab3ed547ab19e598', 'request_id': 'req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.337945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0b30bb31bf42e4ab3ed547ab19e598', 'request_id': 'req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.357661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] The token cache is being invalidate because project 4f0b30bb31bf42e4ab3ed547ab19e598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:44.357952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.359091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.361233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1084/2189] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:44 2022] DELETE /identity/v3/projects/4f0b30bb31bf42e4ab3ed547ab19e598 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:44.363517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.365078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.370890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:44.383440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:44.397221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1106/2190] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:44.397891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.399188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.411337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5298591-3b71-447c-92b1-9992e03880e5 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.417732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.418360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.418640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.419420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] PATH_INFO: `/v3/users/1db5e329ed7244678d92c855df4a153b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.421517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db5e329ed7244678d92c855df4a153b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.424015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.447559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ca2d7-f473-44cb-8a8c-1f23b01a7b02 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.452581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.453197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.453559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.453752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.454401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:44.454702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.456392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.471531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1085/2191] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:44.473294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.481879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db5e329ed7244678d92c855df4a153b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.484513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8e9cb-4a02-4883-b844-ec8dcece5a5e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.490160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.490744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.491116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.491427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.492031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:44.492363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.492883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db5e329ed7244678d92c855df4a153b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.493679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db5e329ed7244678d92c855df4a153b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.493963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.506420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db5e329ed7244678d92c855df4a153b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.513610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1086/2192] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:44.515493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.518056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.518717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db5e329ed7244678d92c855df4a153b'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.525073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1107/2193] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:44 2022] DELETE /identity/v3/users/1db5e329ed7244678d92c855df4a153b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:44.525657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.526975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.539856 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa520273-97f3-4a59-8940-4fd34c3bd58a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.620655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c613-5c85-4540-97fc-e418e41938fa admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.626259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.626844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.627125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.627471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.628161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.632480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.669668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.670927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.671221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.671536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.673063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.674527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1108/2194] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:44.679124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.680164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.737298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:44.737630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1087/2195] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:44.743877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.778212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74129e-d042-4191-b6d2-6bf0aaefbce0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.816105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573b7ee-6e53-4f6a-bef6-93e9e0a9cbee admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.821071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.821798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.822155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.822431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.823059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.825083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.846467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.848691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.849135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.849704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.850365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.852030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1088/2196] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:44.852486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.857482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.868487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f1f2e-888c-45f1-b401-0fceb0ed8f7e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.873234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.874022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.874300 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.874953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.875600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.877263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.879713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:44.881360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1109/2197] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:44 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:44.885281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.893389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1089/2198] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:44.895857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.897433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1606-728b-4f5d-a5e7-bb757da0653b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.898061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:44.907646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.908270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.908584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.908857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.910345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.911687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.918165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5674-fff4-458e-9453-f0053f987c43 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.922202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1110/2199] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:44.923025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.925650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.926420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.926703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.926979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] PATH_INFO: `/v3/projects/229de598c34743799fbcbf78e063c811` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.928118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=229de598c34743799fbcbf78e063c811)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.930069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.933322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd15a-1751-4a56-99a5-66070848ee9c admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.938099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:44.938758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:44.939105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:44.939476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:44.940121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:44.942263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:44.954108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1111/2200] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:44.955099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:44.966976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758dce-74ab-4020-8616-2ef3ba74e3af admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:44.979046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229de598c34743799fbcbf78e063c811', 'request_id': 'req-4eb3b799-7156-426b-9a69-a1df563c9dad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.984947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229de598c34743799fbcbf78e063c811', 'request_id': 'req-4eb3b799-7156-426b-9a69-a1df563c9dad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:44.991857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229de598c34743799fbcbf78e063c811', 'request_id': 'req-4eb3b799-7156-426b-9a69-a1df563c9dad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:45.007651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] The token cache is being invalidate because project 229de598c34743799fbcbf78e063c811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:45.008067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:45.008750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:45.010254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1090/2201] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:44 2022] DELETE /identity/v3/projects/229de598c34743799fbcbf78e063c811 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:45.011117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.012417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.025365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bbdf6-8a2a-4d7d-85e5-1d5c304d6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.025971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bbdf6-8a2a-4d7d-85e5-1d5c304d6217 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.026269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bbdf6-8a2a-4d7d-85e5-1d5c304d6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.026532 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bbdf6-8a2a-4d7d-85e5-1d5c304d6217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.027170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bbdf6-8a2a-4d7d-85e5-1d5c304d6217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.028794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bbdf6-8a2a-4d7d-85e5-1d5c304d6217 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.038481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1112/2202] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:45.039654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.039939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.040221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.060856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:45.062065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.070885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1113/2203] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:45.071642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.072902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.082688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3b799-7156-426b-9a69-a1df563c9dad admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.085561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905b82-a1a7-4a0e-9eb3-1cbafa9bbe6f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.087269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb63014-9c9c-432e-b81f-076e7e6b0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.087945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb63014-9c9c-432e-b81f-076e7e6b0d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.088225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb63014-9c9c-432e-b81f-076e7e6b0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.088532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb63014-9c9c-432e-b81f-076e7e6b0d34 admin admin] PATH_INFO: `/v3/projects/741a4810b6814f4cac75f12936a7d3d7/users/61869276fc7c4162932d04caf497b79d/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.090183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397d29a-0d85-40c9-a0b9-bcb48abf4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.090822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397d29a-0d85-40c9-a0b9-bcb48abf4dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.091104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397d29a-0d85-40c9-a0b9-bcb48abf4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.091378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397d29a-0d85-40c9-a0b9-bcb48abf4dc0 admin admin] PATH_INFO: `/v3/projects/47b34a0024eb4bd3a600c4954eaa527e/users/1c3a35dcf2ab477d8a5c835be71586f5/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.103146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb63014-9c9c-432e-b81f-076e7e6b0d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=741a4810b6814f4cac75f12936a7d3d7, user_id=61869276fc7c4162932d04caf497b79d, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.105930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb63014-9c9c-432e-b81f-076e7e6b0d34 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.106415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397d29a-0d85-40c9-a0b9-bcb48abf4dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b34a0024eb4bd3a600c4954eaa527e, user_id=1c3a35dcf2ab477d8a5c835be71586f5, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.109079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397d29a-0d85-40c9-a0b9-bcb48abf4dc0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.119922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1091/2204] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:45 2022] PUT /identity/v3/projects/741a4810b6814f4cac75f12936a7d3d7/users/61869276fc7c4162932d04caf497b79d/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:45.120895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e7db-c887-4a6c-8be2-9d1cab8b0bb3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.121211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e7db-c887-4a6c-8be2-9d1cab8b0bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.121485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e7db-c887-4a6c-8be2-9d1cab8b0bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.121871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1114/2205] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:45 2022] PUT /identity/v3/projects/47b34a0024eb4bd3a600c4954eaa527e/users/1c3a35dcf2ab477d8a5c835be71586f5/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:45.127045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97711-9d29-4d49-bc44-3ae738731d6e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.127327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97711-9d29-4d49-bc44-3ae738731d6e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.127693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97711-9d29-4d49-bc44-3ae738731d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.141102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3910e7db-c887-4a6c-8be2-9d1cab8b0bb3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:45.142302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3910e7db-c887-4a6c-8be2-9d1cab8b0bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.146760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e8f97711-9d29-4d49-bc44-3ae738731d6e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:45.147908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e8f97711-9d29-4d49-bc44-3ae738731d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.164479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:45.205853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1092/2206] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:45.207770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.208126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.208503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.217540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:45.226652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1115/2207] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:45.229361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97711-9d29-4d49-bc44-3ae738731d6e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.233932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:45.235993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.244235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97711-9d29-4d49-bc44-3ae738731d6e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.246585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1093/2208] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:45.247635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.248927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.252852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.253965 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.254248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.254523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.255179 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:45.255722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.258193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.275041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1116/2209] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:45.276010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.279883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.320383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f7cab-956f-4457-a7b9-9a0902a25858 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.324362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.325057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.325409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.326663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.341999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.343876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.344866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffe018-902b-409c-90cb-2933e11d7445 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.349213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.349834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.350123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.350395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.356646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1094/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:45.357440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.365726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.367174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.372530 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a72d-1dff-4090-9da0-64b54b4467fa service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.377791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.379677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.379818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1117/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:45.379938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.379938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.380227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.382499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.417695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1095/2212] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:45.419415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.434033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d7cb-6db4-4d6f-97fe-273380787465 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.496967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.497701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.498078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.498306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.498964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.501644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.524072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1118/2213] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:45.528181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.539483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312ce2-ca6b-49bd-9b0b-4e9fc7424a59 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.544521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.545116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.545400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.545675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.547690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.549310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.560608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1096/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:45.564914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.577750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0cb54-126d-46c6-a44c-9d7e188fc30d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.583357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b80de-2cb2-4e72-b2b5-cf3e7b358aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.583966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b80de-2cb2-4e72-b2b5-cf3e7b358aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.584248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b80de-2cb2-4e72-b2b5-cf3e7b358aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.584567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b80de-2cb2-4e72-b2b5-cf3e7b358aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.585226 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b80de-2cb2-4e72-b2b5-cf3e7b358aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.587143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b80de-2cb2-4e72-b2b5-cf3e7b358aa2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.598826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1119/2215] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:45.603325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.615172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9c313-f69c-4d1d-9312-d8bde279bae5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.620970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.621621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.621890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.622168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] PATH_INFO: `/v3/projects/05b8ac85813a4bd2af2ea15dd68c1ba1/users/57d8e5fb8990494cb096ccd826612444/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.643480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b8ac85813a4bd2af2ea15dd68c1ba1, user_id=57d8e5fb8990494cb096ccd826612444, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.646745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.661301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1097/2216] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:45 2022] PUT /identity/v3/projects/05b8ac85813a4bd2af2ea15dd68c1ba1/users/57d8e5fb8990494cb096ccd826612444/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:45.673617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4874d-42a9-46d9-8da1-fc28d8a92c8d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.673997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4874d-42a9-46d9-8da1-fc28d8a92c8d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.674275 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4874d-42a9-46d9-8da1-fc28d8a92c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.704393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e1f4874d-42a9-46d9-8da1-fc28d8a92c8d None None] MFA Rules not processed for user `57d8e5fb8990494cb096ccd826612444`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:45.705541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e1f4874d-42a9-46d9-8da1-fc28d8a92c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:45.727668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:45.785435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1120/2217] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:45.789998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.877286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe470-7496-4c18-8a5d-06917ee4602b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:45.888022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:45.889125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:45.889539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:45.889996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:45.891327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:45.893591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:45.955444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1098/2218] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:45.960032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4874d-42a9-46d9-8da1-fc28d8a92c8d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:45.975994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4874d-42a9-46d9-8da1-fc28d8a92c8d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:46.063649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:46.064426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.064867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.065154 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.066901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:46.069281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:46.103650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1121/2219] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:45 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:46.108125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:46.141448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3541-1923-4a16-b448-c8b2736d5b65 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:46.149104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:46.149876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.150395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.150773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.152680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:46.154877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:46.177298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1099/2220] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:46.182215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:46.195294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b334d-e6f7-4434-aba1-903a06e45242 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:46.200446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cfb7e-8c03-46f4-8396-7bf4ef92bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:46.201155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cfb7e-8c03-46f4-8396-7bf4ef92bfa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.201567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cfb7e-8c03-46f4-8396-7bf4ef92bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.201907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cfb7e-8c03-46f4-8396-7bf4ef92bfa8 admin admin] PATH_INFO: `/v3/projects/b24a51193f5741d8a27141e3e27e361b/users/0fd7f71782e64a46bc0a8f4129359f95/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.220309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cfb7e-8c03-46f4-8396-7bf4ef92bfa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a51193f5741d8a27141e3e27e361b, user_id=0fd7f71782e64a46bc0a8f4129359f95, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:46.223989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cfb7e-8c03-46f4-8396-7bf4ef92bfa8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:46.245369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:46.245932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1122/2221] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:46 2022] PUT /identity/v3/projects/b24a51193f5741d8a27141e3e27e361b/users/0fd7f71782e64a46bc0a8f4129359f95/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:46.258400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d6ba1-00db-4b21-91ee-47a87c474c61 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:46.274539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:46.353654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.353894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.354161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.357325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:46.357954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.358235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.358513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.359162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:46.361683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:46.374977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1100/2222] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:46.380219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:46.396506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e358445-75bd-4694-80ee-9255e33b89fc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:46.401543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a3208-fca9-4bb3-b794-b4c2f1ce76dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:46.402294 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a3208-fca9-4bb3-b794-b4c2f1ce76dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.402579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a3208-fca9-4bb3-b794-b4c2f1ce76dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.402851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a3208-fca9-4bb3-b794-b4c2f1ce76dc admin admin] PATH_INFO: `/v3/projects/b24a51193f5741d8a27141e3e27e361b/users/0fd7f71782e64a46bc0a8f4129359f95/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.407753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] MFA Rules not processed for user `1c3a35dcf2ab477d8a5c835be71586f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:46.409585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:46.411607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a3208-fca9-4bb3-b794-b4c2f1ce76dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a51193f5741d8a27141e3e27e361b, user_id=0fd7f71782e64a46bc0a8f4129359f95, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:46.414407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a3208-fca9-4bb3-b794-b4c2f1ce76dc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:46.427891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1101/2223] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:46 2022] PUT /identity/v3/projects/b24a51193f5741d8a27141e3e27e361b/users/0fd7f71782e64a46bc0a8f4129359f95/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:46.438030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.438419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.438765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.478051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] MFA Rules not processed for user `0fd7f71782e64a46bc0a8f4129359f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:46.479504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:46.506661 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1123/2224] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:46.522239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:46.525389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:46.570168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:46.632863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1102/2225] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:46.645389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:46.646838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:46.658656 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828a095-548f-4170-939f-e589244e1dc9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:46.718927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:46.719550 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.719885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.720163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.767505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a5930-5116-4438-87f9-441f4caab633 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:46.775182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d43377-2cab-41e6-ac38-34c963103926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:46.776489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d43377-2cab-41e6-ac38-34c963103926 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:46.777111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d43377-2cab-41e6-ac38-34c963103926 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:46.777658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d43377-2cab-41e6-ac38-34c963103926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:46.795044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:46.796697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:46.803811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d43377-2cab-41e6-ac38-34c963103926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:46.805433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d43377-2cab-41e6-ac38-34c963103926 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:46.808543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1124/2226] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:46.822438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1103/2227] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:47.479062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:47.589164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51388f5-29ae-426c-910c-d4e7d5a10b65 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:47.598251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:47.599019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:47.599414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:47.599787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] PATH_INFO: `/v3/users/57d8e5fb8990494cb096ccd826612444` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:47.601603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d8e5fb8990494cb096ccd826612444)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:47.603729 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:47.679283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:47.709778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d8e5fb8990494cb096ccd826612444'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:47.719285 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d8e5fb8990494cb096ccd826612444'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:47.720139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d8e5fb8990494cb096ccd826612444'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:47.746372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d8e5fb8990494cb096ccd826612444'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:47.764370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d8e5fb8990494cb096ccd826612444'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:47.775669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1125/2228] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:47 2022] DELETE /identity/v3/users/57d8e5fb8990494cb096ccd826612444 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:47.780744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ee80-16e1-4c35-9260-003ccf9e87c9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:47.781142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ee80-16e1-4c35-9260-003ccf9e87c9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:47.781142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ee80-16e1-4c35-9260-003ccf9e87c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:47.830040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f745ee80-16e1-4c35-9260-003ccf9e87c9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:47.832617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f745ee80-16e1-4c35-9260-003ccf9e87c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:47.894749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:47.958048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1104/2229] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:47.991468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:47.993049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:48.078476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16650a-f09c-4d2c-aa8b-2eed0798343f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:48.084529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:48.085157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:48.085437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:48.085711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:48.097999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:48.099778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:48.111546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1126/2230] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:48.323578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02e62-b70d-4bfc-88f5-88f1d69a3c4f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:48.323869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02e62-b70d-4bfc-88f5-88f1d69a3c4f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:48.324149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02e62-b70d-4bfc-88f5-88f1d69a3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:48.348428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fdf02e62-b70d-4bfc-88f5-88f1d69a3c4f None None] MFA Rules not processed for user `1c3a35dcf2ab477d8a5c835be71586f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:48.349741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fdf02e62-b70d-4bfc-88f5-88f1d69a3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:48.420327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1105/2231] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:48.802885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:48.804369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:48.830264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e34d5-d440-4ee3-a60a-0d6b43127afd service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:48.863103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:48.863797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:48.864091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:48.866119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] PATH_INFO: `/v3/projects/05b8ac85813a4bd2af2ea15dd68c1ba1` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:48.869715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b8ac85813a4bd2af2ea15dd68c1ba1)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:48.874081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:48.971427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b8ac85813a4bd2af2ea15dd68c1ba1', 'request_id': 'req-2220f27c-9a2a-4eec-9007-a15eb049e22d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:48.984761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b8ac85813a4bd2af2ea15dd68c1ba1', 'request_id': 'req-2220f27c-9a2a-4eec-9007-a15eb049e22d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:48.996012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b8ac85813a4bd2af2ea15dd68c1ba1', 'request_id': 'req-2220f27c-9a2a-4eec-9007-a15eb049e22d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.016631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] The token cache is being invalidate because project 05b8ac85813a4bd2af2ea15dd68c1ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:49.016954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.027676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.031052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1127/2232] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:48 2022] DELETE /identity/v3/projects/05b8ac85813a4bd2af2ea15dd68c1ba1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:49.035354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf02e62-b70d-4bfc-88f5-88f1d69a3c4f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:49.051745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf02e62-b70d-4bfc-88f5-88f1d69a3c4f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:49.153911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:49.154899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:49.155802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:49.156177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] PATH_INFO: `/v3/users/0fd7f71782e64a46bc0a8f4129359f95` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:49.157554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd7f71782e64a46bc0a8f4129359f95)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:49.160808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:49.236785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd7f71782e64a46bc0a8f4129359f95'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.255924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd7f71782e64a46bc0a8f4129359f95'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.257255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd7f71782e64a46bc0a8f4129359f95'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.279444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd7f71782e64a46bc0a8f4129359f95'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.295157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:49.299501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-565b7f91-3fc2-48ca-aaba-e70a0ffdece0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd7f71782e64a46bc0a8f4129359f95'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.318698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1106/2233] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:49 2022] DELETE /identity/v3/users/0fd7f71782e64a46bc0a8f4129359f95 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:49.725966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:49.727437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:49.753437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220f27c-9a2a-4eec-9007-a15eb049e22d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:49.830586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:49.879409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:49.881010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:49.881531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:49.882034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] PATH_INFO: `/v3/projects/b24a51193f5741d8a27141e3e27e361b` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:49.883841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24a51193f5741d8a27141e3e27e361b)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:49.886394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:49.974939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24a51193f5741d8a27141e3e27e361b', 'request_id': 'req-63d03c37-b73a-448f-b651-63aba8102edc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:49.988321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24a51193f5741d8a27141e3e27e361b', 'request_id': 'req-63d03c37-b73a-448f-b651-63aba8102edc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:50.000079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24a51193f5741d8a27141e3e27e361b', 'request_id': 'req-63d03c37-b73a-448f-b651-63aba8102edc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:50.020979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] The token cache is being invalidate because project b24a51193f5741d8a27141e3e27e361b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:50.021288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:50.022015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-63d03c37-b73a-448f-b651-63aba8102edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:50.024595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1128/2234] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:49 2022] DELETE /identity/v3/projects/b24a51193f5741d8a27141e3e27e361b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:50.031199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2316c4-38b3-4e42-a5bf-5b156a0ebbea None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:50.031656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2316c4-38b3-4e42-a5bf-5b156a0ebbea None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:50.031986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2316c4-38b3-4e42-a5bf-5b156a0ebbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:50.064316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bb2316c4-38b3-4e42-a5bf-5b156a0ebbea None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:50.068475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bb2316c4-38b3-4e42-a5bf-5b156a0ebbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:50.207669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1107/2235] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:50.215317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccfa63-14bf-45f4-bed9-edfe5c84338d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:50.215620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccfa63-14bf-45f4-bed9-edfe5c84338d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:50.215894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccfa63-14bf-45f4-bed9-edfe5c84338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:50.254514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d9ccfa63-14bf-45f4-bed9-edfe5c84338d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:50.255767 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d9ccfa63-14bf-45f4-bed9-edfe5c84338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:50.281754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1129/2236] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:50.286707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2316c4-38b3-4e42-a5bf-5b156a0ebbea None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:50.303380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2316c4-38b3-4e42-a5bf-5b156a0ebbea None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:50.322111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:50.323086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:50.323798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:50.324184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:50.325233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:50.325668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:50.328185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:50.371397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1108/2237] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:50.372705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccfa63-14bf-45f4-bed9-edfe5c84338d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:50.423597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccfa63-14bf-45f4-bed9-edfe5c84338d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:50.449344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:50.450370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:50.450760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:50.451148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:50.452076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:50.481058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:50.608790 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1130/2238] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:50 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:50.611594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:50.629867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab7e5c-e2a0-4370-a570-35f797b4edb3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:50.786921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:50.787926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:50.788451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:50.788945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:50.793029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:50.801398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:50.855061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1109/2239] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:50 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:50.859714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:50.879730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6ed8-4f03-4a5f-8326-694ef694320d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:50.885921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:50.886881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:50.887171 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:50.888413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:50.889073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:50.890850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:50.907260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1131/2240] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:50.911196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:50.929107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44522ef-6d00-4e1d-9fb2-00b67b58fd79 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:50.934487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc0a1-1cba-430e-8651-ddbf7fe31a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:50.936006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc0a1-1cba-430e-8651-ddbf7fe31a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:50.936391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc0a1-1cba-430e-8651-ddbf7fe31a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:50.936676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc0a1-1cba-430e-8651-ddbf7fe31a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:50.938642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc0a1-1cba-430e-8651-ddbf7fe31a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:50.940340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc0a1-1cba-430e-8651-ddbf7fe31a53 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:51.008542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1110/2241] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:29:51.016036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:51.028308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f067a11-34cb-4f11-bc6e-c1de6d53b3b1 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:51.038620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:51.039307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.039747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.040033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] PATH_INFO: `/v3/projects/1f62803d336c4821bdae21a11140c7a4/users/376e3b562be840fbb1ee8e750490f27d/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.059256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f62803d336c4821bdae21a11140c7a4, user_id=376e3b562be840fbb1ee8e750490f27d, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:51.063424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:51.092327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1132/2242] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:51 2022] PUT /identity/v3/projects/1f62803d336c4821bdae21a11140c7a4/users/376e3b562be840fbb1ee8e750490f27d/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:51.098888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd15e6-6902-4f18-a820-ad1803d39e4f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.099425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd15e6-6902-4f18-a820-ad1803d39e4f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.099425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd15e6-6902-4f18-a820-ad1803d39e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.141946 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-74bd15e6-6902-4f18-a820-ad1803d39e4f None None] MFA Rules not processed for user `376e3b562be840fbb1ee8e750490f27d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:51.143173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-74bd15e6-6902-4f18-a820-ad1803d39e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:51.215587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:51.251710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1111/2243] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:51.252564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:51.343991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef56d40-8ff6-4e22-8ff9-b6c3bbda7843 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:51.345727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:51.352499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e10509-520f-4019-995b-a8ac824916a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:51.353478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e10509-520f-4019-995b-a8ac824916a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.353997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e10509-520f-4019-995b-a8ac824916a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.354879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e10509-520f-4019-995b-a8ac824916a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.356264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e10509-520f-4019-995b-a8ac824916a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:51.358346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e10509-520f-4019-995b-a8ac824916a2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:51.404254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1133/2244] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:51 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:51.408420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd15e6-6902-4f18-a820-ad1803d39e4f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:51.425299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd15e6-6902-4f18-a820-ad1803d39e4f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:51.582481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:51.584101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.585004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.585530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.585832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.586121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.586328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.587249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:51.591867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:51.657968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] MFA Rules not processed for user `61869276fc7c4162932d04caf497b79d`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:51.659893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:51.672578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1112/2245] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:51 2022] POST /identity/v3/users => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:51.676457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:51.697892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d197-940f-43d5-adcd-441ed4739716 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:51.706898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:51.707547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.707821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.708082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.708854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:51.710501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:51.728046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1113/2246] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:51.738977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:51.773167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e17f91-2a8a-49ce-9b17-6aa5c17e344d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:51.780741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1134/2247] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:51.786774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:51.788866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:51.792793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:51.793486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.793769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.794050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] PATH_INFO: `/v3/projects/18f00c55dcb24c1996493a8730f3e746/users/e17a1e120a294d4a8d84b4515d56dd9b/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.809546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635274c6-fc40-4915-9c11-2ce894a1caff None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:51.820662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:51.821304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:51.821786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:51.822105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:51.822892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:51.825834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:51.836758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f00c55dcb24c1996493a8730f3e746, user_id=e17a1e120a294d4a8d84b4515d56dd9b, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:51.838740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:51.866357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1114/2248] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:51 2022] PUT /identity/v3/projects/18f00c55dcb24c1996493a8730f3e746/users/e17a1e120a294d4a8d84b4515d56dd9b/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:51.871788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:51.910829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1135/2249] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:51 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:51.915142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:52.021485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c1eb2-c6c1-45d9-a501-8dffc7a371f8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.065081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7851e45-57e6-4903-aaca-a685a3796e28 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.090832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.091565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.092267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.092902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.097464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.102647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.148480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:52.151045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1136/2250] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:51 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:52.155247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:52.162669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.163442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.163826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.164198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.165054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.166938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.177544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3181-c5fe-4bd4-853d-59404a6e58fe admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.180321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1115/2251] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:52.184620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:52.188095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.188978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.189276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.189613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.190677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.192685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.207098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3dcb2-7fcd-418f-9758-c769418eee43 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.208260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1137/2252] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:52.214678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:52.217249 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf755f-a624-4fc9-9977-6868931f2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.218231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf755f-a624-4fc9-9977-6868931f2a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.218668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf755f-a624-4fc9-9977-6868931f2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.219041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf755f-a624-4fc9-9977-6868931f2a44 admin admin] PATH_INFO: `/v3/projects/18f00c55dcb24c1996493a8730f3e746/users/e17a1e120a294d4a8d84b4515d56dd9b/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.221342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf755f-a624-4fc9-9977-6868931f2a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f00c55dcb24c1996493a8730f3e746, user_id=e17a1e120a294d4a8d84b4515d56dd9b, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.225924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf755f-a624-4fc9-9977-6868931f2a44 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.239653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ada8-47dc-4044-9a3c-f16ab001b86f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.246606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1116/2253] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:52 2022] PUT /identity/v3/projects/18f00c55dcb24c1996493a8730f3e746/users/e17a1e120a294d4a8d84b4515d56dd9b/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:52.257637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.257919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.258199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.293195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:52.308819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] MFA Rules not processed for user `e17a1e120a294d4a8d84b4515d56dd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:52.310736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:52.377016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.377711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.378027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.378317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] PATH_INFO: `/v3/projects/79fce63f3a9e4e64bfcb13d771ce96a1/users/243b1ed42ac442b798a79e2002016bae/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.402478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fce63f3a9e4e64bfcb13d771ce96a1, user_id=243b1ed42ac442b798a79e2002016bae, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.406225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.441454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1138/2254] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:52 2022] PUT /identity/v3/projects/79fce63f3a9e4e64bfcb13d771ce96a1/users/243b1ed42ac442b798a79e2002016bae/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:52.443957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:52.472213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1117/2255] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:52.483778 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:52.485352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:52.599214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db15a0-a4c9-4e14-8931-125b0d998d39 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.615591 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b96ef-feb1-4ef5-a69b-d76dbdb402a5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.631692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.632582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.632982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.633610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.634321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.636830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.670976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88038be-7995-45ba-9653-eafe6ebf7b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.671598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88038be-7995-45ba-9653-eafe6ebf7b37 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.671874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88038be-7995-45ba-9653-eafe6ebf7b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.672317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88038be-7995-45ba-9653-eafe6ebf7b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.684206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1139/2256] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:29:52.685899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:52.720887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:52.724967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef3575-f74e-40b2-a5e9-b3c2d4be13eb admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:52.733809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:52.734566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:52.734853 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:52.735131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] PATH_INFO: `/v3/projects/79fce63f3a9e4e64bfcb13d771ce96a1/users/243b1ed42ac442b798a79e2002016bae/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:52.738822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fce63f3a9e4e64bfcb13d771ce96a1, user_id=243b1ed42ac442b798a79e2002016bae, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.742810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.757104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1140/2257] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:29:52 2022] PUT /identity/v3/projects/79fce63f3a9e4e64bfcb13d771ce96a1/users/243b1ed42ac442b798a79e2002016bae/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:52.770532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88038be-7995-45ba-9653-eafe6ebf7b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:52.772957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88038be-7995-45ba-9653-eafe6ebf7b37 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:52.790913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1118/2258] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:53.004385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:53.112752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfdb4a-2314-4239-8a17-cceb09089cf1 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:53.117184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92524b-43c7-4c0b-8b11-339ad89ee98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:53.119216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92524b-43c7-4c0b-8b11-339ad89ee98e service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:53.119567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92524b-43c7-4c0b-8b11-339ad89ee98e service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:53.120060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92524b-43c7-4c0b-8b11-339ad89ee98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:53.231762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:53.274819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92524b-43c7-4c0b-8b11-339ad89ee98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:53.276836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92524b-43c7-4c0b-8b11-339ad89ee98e service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:53.293117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1141/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:29:56.249311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759a98-9a6d-422c-92e9-4344c242bab6 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:56.250102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759a98-9a6d-422c-92e9-4344c242bab6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:56.250203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759a98-9a6d-422c-92e9-4344c242bab6 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:56.251702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1119/2260] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:29:56.270135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87605a-515b-4b48-ae61-1da0d004d7c1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:56.271183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87605a-515b-4b48-ae61-1da0d004d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:56.271674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87605a-515b-4b48-ae61-1da0d004d7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:56.327513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6e87605a-515b-4b48-ae61-1da0d004d7c1 None None] MFA Rules not processed for user `5129b0c17f1a4579b26a2e50369648d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:56.329372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6e87605a-515b-4b48-ae61-1da0d004d7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:56.443018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1142/2261] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:56.458151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09759a98-9a6d-422c-92e9-4344c242bab6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:56.460461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-09759a98-9a6d-422c-92e9-4344c242bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:56.491128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87605a-515b-4b48-ae61-1da0d004d7c1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:56.525317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09759a98-9a6d-422c-92e9-4344c242bab6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:56.551585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a7c4d-3bd1-42b3-aee9-987954d80dc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:56.552533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7c4d-3bd1-42b3-aee9-987954d80dc3 service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:56.552958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7c4d-3bd1-42b3-aee9-987954d80dc3 service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:56.553395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7c4d-3bd1-42b3-aee9-987954d80dc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:56.575633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a7c4d-3bd1-42b3-aee9-987954d80dc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:56.577544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a7c4d-3bd1-42b3-aee9-987954d80dc3 service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:56.598391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1120/2262] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:56.663025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87605a-515b-4b48-ae61-1da0d004d7c1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:56.669579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:56.670541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:56.671072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:56.671696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] PATH_INFO: `/v3/users/376e3b562be840fbb1ee8e750490f27d` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:56.675447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376e3b562be840fbb1ee8e750490f27d)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:56.678335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:56.767308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376e3b562be840fbb1ee8e750490f27d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:56.780947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376e3b562be840fbb1ee8e750490f27d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:56.782563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376e3b562be840fbb1ee8e750490f27d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:56.808064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376e3b562be840fbb1ee8e750490f27d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:56.849015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376e3b562be840fbb1ee8e750490f27d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:56.857455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1143/2263] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:56 2022] DELETE /identity/v3/users/376e3b562be840fbb1ee8e750490f27d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:56.862224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:56.862726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:56.863666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:56.900713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:56.905867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:57.076642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1121/2264] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:29:57.117634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:57.119462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:57.128192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:57.272321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abd935-ef3a-4ce7-a60b-f5bad3ccd8a6 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:57.286696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:57.287346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:57.287675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:57.287877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:57.309664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:57.311272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:57.334582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1144/2265] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:29:57.767689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:57.769931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:57.794320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31342b-5f80-4fd3-a1b2-f8bac36eb6e3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:57.799652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:57.800309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:57.800620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:57.800895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] PATH_INFO: `/v3/projects/1f62803d336c4821bdae21a11140c7a4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:57.802756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f62803d336c4821bdae21a11140c7a4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:57.804950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:57.935983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f62803d336c4821bdae21a11140c7a4', 'request_id': 'req-0209d9e3-359b-4921-a13f-e21682c91ab7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:57.938436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:57.940588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:57.946094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f62803d336c4821bdae21a11140c7a4', 'request_id': 'req-0209d9e3-359b-4921-a13f-e21682c91ab7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:57.962069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f62803d336c4821bdae21a11140c7a4', 'request_id': 'req-0209d9e3-359b-4921-a13f-e21682c91ab7'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:57.989868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] The token cache is being invalidate because project 1f62803d336c4821bdae21a11140c7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:57.991228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:57.992812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.023985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cabea-0a90-4f83-a039-37b25f98be39 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:58.025779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1122/2266] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:57 2022] DELETE /identity/v3/projects/1f62803d336c4821bdae21a11140c7a4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:58.027054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:58.033025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:58.151297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:58.166015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:58.166667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:58.167124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:58.167425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] PATH_INFO: `/v3/users/2855a08f24b847cea8194f23fc468a5d` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:58.169318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2855a08f24b847cea8194f23fc468a5d)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:58.171268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:58.213268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209d9e3-359b-4921-a13f-e21682c91ab7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:58.232214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:58.233576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:58.234469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:58.235825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] PATH_INFO: `/v3/users/e17a1e120a294d4a8d84b4515d56dd9b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:58.238118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17a1e120a294d4a8d84b4515d56dd9b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:58.245915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:58.283120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2855a08f24b847cea8194f23fc468a5d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.298492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2855a08f24b847cea8194f23fc468a5d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.299364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2855a08f24b847cea8194f23fc468a5d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.310306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2855a08f24b847cea8194f23fc468a5d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.345502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2855a08f24b847cea8194f23fc468a5d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.364651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1145/2267] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:57 2022] DELETE /identity/v3/users/2855a08f24b847cea8194f23fc468a5d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:58.364875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17a1e120a294d4a8d84b4515d56dd9b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.380845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17a1e120a294d4a8d84b4515d56dd9b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.382676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17a1e120a294d4a8d84b4515d56dd9b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.408006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17a1e120a294d4a8d84b4515d56dd9b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.421501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17a1e120a294d4a8d84b4515d56dd9b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:58.431092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1123/2268] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:58 2022] DELETE /identity/v3/users/e17a1e120a294d4a8d84b4515d56dd9b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:58.831618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:58.833131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:58.900785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:58.930772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:58.932320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:59.014504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c0ba2-7890-490f-a839-e77a2e7097e9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:59.122654 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0ac7a-332f-44e2-8379-7eb095c542c8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:59.129475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:59.130309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:59.130760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:59.131243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] PATH_INFO: `/v3/projects/18f00c55dcb24c1996493a8730f3e746` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:59.132802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f00c55dcb24c1996493a8730f3e746)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:59.134981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:59.147964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:59.148652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:59.148932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:59.150038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] PATH_INFO: `/v3/projects/160fe0a096294039a35d70c52c6ee81a` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:59.151235 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=160fe0a096294039a35d70c52c6ee81a)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:59.153966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:59.209829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f00c55dcb24c1996493a8730f3e746', 'request_id': 'req-44e8c9e2-661c-4ab0-adb1-89a6e9930220'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.221150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:59.227005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f00c55dcb24c1996493a8730f3e746', 'request_id': 'req-44e8c9e2-661c-4ab0-adb1-89a6e9930220'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.228368 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160fe0a096294039a35d70c52c6ee81a', 'request_id': 'req-b58611ae-04ad-4b4c-bd32-647b17599dc1'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.238409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f00c55dcb24c1996493a8730f3e746', 'request_id': 'req-44e8c9e2-661c-4ab0-adb1-89a6e9930220'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.241533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160fe0a096294039a35d70c52c6ee81a', 'request_id': 'req-b58611ae-04ad-4b4c-bd32-647b17599dc1'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.250682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160fe0a096294039a35d70c52c6ee81a', 'request_id': 'req-b58611ae-04ad-4b4c-bd32-647b17599dc1'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.259446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] The token cache is being invalidate because project 18f00c55dcb24c1996493a8730f3e746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:59.259831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.260588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-44e8c9e2-661c-4ab0-adb1-89a6e9930220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.268147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1124/2269] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:58 2022] DELETE /identity/v3/projects/18f00c55dcb24c1996493a8730f3e746 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:59.270196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] The token cache is being invalidate because project 160fe0a096294039a35d70c52c6ee81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:29:59.272254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.273118 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.274925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1146/2270] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:29:58 2022] DELETE /identity/v3/projects/160fe0a096294039a35d70c52c6ee81a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:59.275181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c349da-4bf6-41ea-b903-bd5d571a0ed7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:59.275475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c349da-4bf6-41ea-b903-bd5d571a0ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:59.275766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c349da-4bf6-41ea-b903-bd5d571a0ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:59.281709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:59.284517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:59.317834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a3c349da-4bf6-41ea-b903-bd5d571a0ed7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:59.319480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a3c349da-4bf6-41ea-b903-bd5d571a0ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:59.449777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1125/2271] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:59.457860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1600a-f921-4610-9d4b-e1ab399d2e60 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:59.458422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1600a-f921-4610-9d4b-e1ab399d2e60 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:59.458936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1600a-f921-4610-9d4b-e1ab399d2e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:59.465313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58611ae-04ad-4b4c-bd32-647b17599dc1 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:59.471083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:59.473122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:59.474025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:59.475213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] PATH_INFO: `/v3/users/68673aa9407941f5a1ae554eace44a1a` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:59.476923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68673aa9407941f5a1ae554eace44a1a)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:59.480666 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:59.504593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:29:59.507729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8ae1600a-f921-4610-9d4b-e1ab399d2e60 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:29:59.509600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8ae1600a-f921-4610-9d4b-e1ab399d2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:59.540517 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1126/2272] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:29:59.541581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1600a-f921-4610-9d4b-e1ab399d2e60 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:59.573750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1600a-f921-4610-9d4b-e1ab399d2e60 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:59.587324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:59.588311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:59.588630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:59.589632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:59.591368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:29:59.592746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:59.596995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:59.622312 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1127/2273] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:29:59.627371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:59.650648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d746fc-8817-4002-8a59-2568e211ee19 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:59.656422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:29:59.657491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:29:59.657491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:29:59.657887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:29:59.658549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:29:59.660943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:29:59.684858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68673aa9407941f5a1ae554eace44a1a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.720141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68673aa9407941f5a1ae554eace44a1a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.720660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68673aa9407941f5a1ae554eace44a1a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.750207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68673aa9407941f5a1ae554eace44a1a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.756699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1128/2274] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:29:59 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:29:59.760563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:29:59.763227 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:29:59.777451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68673aa9407941f5a1ae554eace44a1a'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:29:59.791982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1147/2275] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:29:59 2022] DELETE /identity/v3/users/68673aa9407941f5a1ae554eace44a1a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:29:59.900145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725b52b-93d6-49e3-8ced-4d49d14bf574 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:29:59.979003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:00.003946 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.004616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.004895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.005171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.007518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.007796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.035320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1129/2276] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:29:59 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:30:00.039131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:00.052989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e195a-3623-4c1e-8a3b-b6ae41a57106 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:00.058968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.059922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.059922 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.060177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.060830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.063074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.084330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1148/2277] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:00.087691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:00.101469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e174-4566-4fa9-bc5a-a9ccdfa6436d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:00.107395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec2b9d-e25f-4acd-9620-e41fbfa5d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.108141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec2b9d-e25f-4acd-9620-e41fbfa5d66e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.108555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec2b9d-e25f-4acd-9620-e41fbfa5d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.108968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec2b9d-e25f-4acd-9620-e41fbfa5d66e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.109970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec2b9d-e25f-4acd-9620-e41fbfa5d66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.112029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec2b9d-e25f-4acd-9620-e41fbfa5d66e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.125124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1130/2278] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:00.129347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:00.140389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33068f88-c236-4951-94c2-9f92edd8a89f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:00.145579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.146279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.146660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.146937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] PATH_INFO: `/v3/projects/10ae7a30565e48a2880a4197704eca38/users/920e7b960eb24fddb848939d83d42b54/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.169635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ae7a30565e48a2880a4197704eca38, user_id=920e7b960eb24fddb848939d83d42b54, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.172393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.189035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1149/2279] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:00 2022] PUT /identity/v3/projects/10ae7a30565e48a2880a4197704eca38/users/920e7b960eb24fddb848939d83d42b54/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:00.203029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27825-819a-474b-9d04-1a6ae7faafa4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.203216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27825-819a-474b-9d04-1a6ae7faafa4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.203437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27825-819a-474b-9d04-1a6ae7faafa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.238586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9cc27825-819a-474b-9d04-1a6ae7faafa4 None None] MFA Rules not processed for user `920e7b960eb24fddb848939d83d42b54`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:00.239922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9cc27825-819a-474b-9d04-1a6ae7faafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.278502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:00.280329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.337478 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1131/2280] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:00.339762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.340127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.340436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.382893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] MFA Rules not processed for user `243b1ed42ac442b798a79e2002016bae`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:00.384332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.406667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb1b10-b9bd-4227-b6e9-03b9480f1e76 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:00.413231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.414137 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.414586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.415006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] PATH_INFO: `/v3/projects/2463eedcbdfe46df91f4f5e8b120af4c` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.416341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2463eedcbdfe46df91f4f5e8b120af4c)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.418402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.473213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1132/2281] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:00.473887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:00.475496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.480818 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2463eedcbdfe46df91f4f5e8b120af4c', 'request_id': 'req-a65d5f40-f444-48c4-85e6-75b932642d99'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:00.483415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:00.492719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2463eedcbdfe46df91f4f5e8b120af4c', 'request_id': 'req-a65d5f40-f444-48c4-85e6-75b932642d99'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:00.501555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2463eedcbdfe46df91f4f5e8b120af4c', 'request_id': 'req-a65d5f40-f444-48c4-85e6-75b932642d99'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:00.513803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] The token cache is being invalidate because project 2463eedcbdfe46df91f4f5e8b120af4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:00.514102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:00.514925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:00.517205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1150/2282] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:00 2022] DELETE /identity/v3/projects/2463eedcbdfe46df91f4f5e8b120af4c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:30:00.518880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:00.520451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.529786 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:00.545996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466097f-73e5-4f94-8f0d-dfacde15ec3f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:00.589419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d5f40-f444-48c4-85e6-75b932642d99 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:00.593501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b45e-ab34-41ea-9549-46c0f6702169 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.594102 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b45e-ab34-41ea-9549-46c0f6702169 service glance] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.594389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b45e-ab34-41ea-9549-46c0f6702169 service glance] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.594659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b45e-ab34-41ea-9549-46c0f6702169 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.596597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c8d5b45e-ab34-41ea-9549-46c0f6702169 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.599734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bcf22-100a-482f-9d8c-00ea16ebe8d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.600364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcf22-100a-482f-9d8c-00ea16ebe8d9 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.600683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcf22-100a-482f-9d8c-00ea16ebe8d9 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.601087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcf22-100a-482f-9d8c-00ea16ebe8d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.602959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-da6bcf22-100a-482f-9d8c-00ea16ebe8d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.657782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5b45e-ab34-41ea-9549-46c0f6702169 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.659243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5b45e-ab34-41ea-9549-46c0f6702169 service glance] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.668641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1151/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:00.670172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181a37-aef8-4975-9a9b-88bf54c079f4 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.670522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bcf22-100a-482f-9d8c-00ea16ebe8d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.670637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181a37-aef8-4975-9a9b-88bf54c079f4 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.670814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181a37-aef8-4975-9a9b-88bf54c079f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.671974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bcf22-100a-482f-9d8c-00ea16ebe8d9 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.687597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1133/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:00.691521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a7181a37-aef8-4975-9a9b-88bf54c079f4 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:00.692750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a7181a37-aef8-4975-9a9b-88bf54c079f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.787508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1152/2285] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:00.796068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001a7bb-c624-4b88-857d-a1c1c6a9c8e8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.796445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001a7bb-c624-4b88-857d-a1c1c6a9c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.796824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001a7bb-c624-4b88-857d-a1c1c6a9c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.831783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9001a7bb-c624-4b88-857d-a1c1c6a9c8e8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:00.833095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9001a7bb-c624-4b88-857d-a1c1c6a9c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.864872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f464a3-c07b-4506-a35c-7708367c5012 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.865220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f464a3-c07b-4506-a35c-7708367c5012 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.865435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f464a3-c07b-4506-a35c-7708367c5012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.868970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1134/2286] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:00.877724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001a7bb-c624-4b88-857d-a1c1c6a9c8e8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:00.895034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001a7bb-c624-4b88-857d-a1c1c6a9c8e8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:00.906839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-59f464a3-c07b-4506-a35c-7708367c5012 None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:00.907705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:00.912364 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:00.912776 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:00.913390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:00.913562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-59f464a3-c07b-4506-a35c-7708367c5012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:00.914346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:30:00.915910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:00.919714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:00.961977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1135/2287] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:30:00.968533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:01.000322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0aefa-a375-4351-8cf2-650aee94afb6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:01.012501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:01.013737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:01.014441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.016057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.016234 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.017718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:01.020196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:01.092682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1153/2288] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:30:01.102904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1136/2289] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:30:00 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:01.105667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f464a3-c07b-4506-a35c-7708367c5012 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:01.133485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f464a3-c07b-4506-a35c-7708367c5012 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:01.176982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:01.178828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:01.292218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:01.293676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.293998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.294546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.295428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:01.298728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:01.334842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1154/2290] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:30:01 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:01.336709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:01.352866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac45850-ad67-4e6a-b6b1-1b58827faafe admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:01.367247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33c86-92c6-4159-b558-31afda197ae3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:01.370389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db6c9-18ea-4ac8-9fa2-fda951c6ebb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:01.371200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db6c9-18ea-4ac8-9fa2-fda951c6ebb2 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.371627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db6c9-18ea-4ac8-9fa2-fda951c6ebb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.372065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db6c9-18ea-4ac8-9fa2-fda951c6ebb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.380388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:01.383292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.383609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.385125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.385841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:01.391999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:01.405653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:01.428428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1155/2291] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:01.431050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:01.449665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9891d0-b2bb-48ea-b79b-11809c9b21ec admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:01.457780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:01.458552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.458931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.459303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.460050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:01.461873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:01.484402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1156/2292] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:30:01.489130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:01.505687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567eb4-2ff5-4b1f-bc3f-be410111f694 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:01.507206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4db6c9-18ea-4ac8-9fa2-fda951c6ebb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:01.508865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4db6c9-18ea-4ac8-9fa2-fda951c6ebb2 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:01.519298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:01.520105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.520418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.520824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] PATH_INFO: `/v3/projects/7ce704a11f6f433498b180fe00f5b747/users/8102de90641b4ca1b928832eea32e829/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.545727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1137/2293] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:30:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:30:01.555524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce704a11f6f433498b180fe00f5b747, user_id=8102de90641b4ca1b928832eea32e829, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:01.558434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:01.603176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1157/2294] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:01 2022] PUT /identity/v3/projects/7ce704a11f6f433498b180fe00f5b747/users/8102de90641b4ca1b928832eea32e829/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:30:01.620641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a3bf8-4148-4d1f-8b52-87b5d8b44b52 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.620971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a3bf8-4148-4d1f-8b52-87b5d8b44b52 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.621203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a3bf8-4148-4d1f-8b52-87b5d8b44b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.667942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a10a3bf8-4148-4d1f-8b52-87b5d8b44b52 None None] MFA Rules not processed for user `8102de90641b4ca1b928832eea32e829`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:01.669283 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a10a3bf8-4148-4d1f-8b52-87b5d8b44b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:01.821772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1138/2295] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:01.837523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:01.839740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:01.949847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a719ab2-49b3-445c-b16f-d9597cc4ea29 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:01.957689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0334b53-d01a-4476-ab3d-6533c4d0af73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:01.958318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0334b53-d01a-4476-ab3d-6533c4d0af73 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:01.958595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0334b53-d01a-4476-ab3d-6533c4d0af73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:01.958866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0334b53-d01a-4476-ab3d-6533c4d0af73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:01.984979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0334b53-d01a-4476-ab3d-6533c4d0af73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:01.986448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0334b53-d01a-4476-ab3d-6533c4d0af73 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:02.014876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1158/2296] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:02.047443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a3bf8-4148-4d1f-8b52-87b5d8b44b52 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:02.187408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a3bf8-4148-4d1f-8b52-87b5d8b44b52 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:02.202440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:02.202440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:02.202440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:02.202440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] PATH_INFO: `/v3/users/8102de90641b4ca1b928832eea32e829` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:02.207569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8102de90641b4ca1b928832eea32e829)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:02.211820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:02.328965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:02.334928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8102de90641b4ca1b928832eea32e829'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:02.354474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8102de90641b4ca1b928832eea32e829'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:02.355477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8102de90641b4ca1b928832eea32e829'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:02.401954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8102de90641b4ca1b928832eea32e829'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:02.426544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8102de90641b4ca1b928832eea32e829'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:02.461133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1139/2297] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:30:02 2022] DELETE /identity/v3/users/8102de90641b4ca1b928832eea32e829 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:02.465929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:02.466460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:02.466761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:02.503143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:02.504413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:02.565893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:02.653033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1159/2298] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:02.658668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:02.662033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:02.825504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660f96-24e1-4b4e-8433-f8f32f21d003 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:02.835103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eb5a9-c30e-4dac-911e-27698d8fe083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:02.835744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eb5a9-c30e-4dac-911e-27698d8fe083 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:02.836028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eb5a9-c30e-4dac-911e-27698d8fe083 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:02.836464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eb5a9-c30e-4dac-911e-27698d8fe083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:02.855160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19eb5a9-c30e-4dac-911e-27698d8fe083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:02.857088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19eb5a9-c30e-4dac-911e-27698d8fe083 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:02.873930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1140/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:03.468977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:03.470490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:03.493629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58577b-7c08-49a0-8c28-200bd937bdd3 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:03.501711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:03.502395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:03.504208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:03.504903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] PATH_INFO: `/v3/projects/7ce704a11f6f433498b180fe00f5b747` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:03.513539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce704a11f6f433498b180fe00f5b747)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:03.522234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:03.610316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce704a11f6f433498b180fe00f5b747', 'request_id': 'req-eadab5bf-f9d4-4091-a53b-5e08602f5035'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:03.639456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce704a11f6f433498b180fe00f5b747', 'request_id': 'req-eadab5bf-f9d4-4091-a53b-5e08602f5035'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:03.657871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce704a11f6f433498b180fe00f5b747', 'request_id': 'req-eadab5bf-f9d4-4091-a53b-5e08602f5035'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:03.676576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] The token cache is being invalidate because project 7ce704a11f6f433498b180fe00f5b747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:03.676576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:03.676881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-eadab5bf-f9d4-4091-a53b-5e08602f5035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:03.678664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1160/2300] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:03 2022] DELETE /identity/v3/projects/7ce704a11f6f433498b180fe00f5b747 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:03.683393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed4ae2-a12d-4e29-9852-855825e71bb9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:03.683962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed4ae2-a12d-4e29-9852-855825e71bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:03.683962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed4ae2-a12d-4e29-9852-855825e71bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:03.741190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-77ed4ae2-a12d-4e29-9852-855825e71bb9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:03.742583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-77ed4ae2-a12d-4e29-9852-855825e71bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:03.984587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1141/2301] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:03.989997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf311-5514-40a8-92aa-ef19bb1b9c7e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:03.990291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf311-5514-40a8-92aa-ef19bb1b9c7e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:03.990769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf311-5514-40a8-92aa-ef19bb1b9c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.039445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-3aabf311-5514-40a8-92aa-ef19bb1b9c7e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:04.040784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3aabf311-5514-40a8-92aa-ef19bb1b9c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:04.061599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1161/2302] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:04.066291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed4ae2-a12d-4e29-9852-855825e71bb9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:04.080410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed4ae2-a12d-4e29-9852-855825e71bb9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:04.100958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:04.101717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:04.102269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:04.102673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.103513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:30:04.104391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:04.106128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:04.123771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1142/2303] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:30:04.126119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabf311-5514-40a8-92aa-ef19bb1b9c7e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:04.137041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabf311-5514-40a8-92aa-ef19bb1b9c7e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:04.144607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:04.146713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:04.149183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:04.149183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.149439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:04.151728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:04.237397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1162/2304] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:30:04 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:04.238183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:04.250101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28d73b-d2f7-4b7f-9ce5-43239ac5d30d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:04.388621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:04.414013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:04.415745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:04.416710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:04.417011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.438015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:04.440596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:04.497825 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:04.506589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1143/2305] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:30:04 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:30:04.523128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84624c8-1b30-449b-9eee-6cce6fe93ca4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:04.529645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:04.530396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:04.530848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:04.531122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.531778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:04.533444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:04.551930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1163/2306] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:04.555798 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:04.570737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de3177-3341-4844-bf6f-d503c3988054 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:04.580315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65f2d6-f576-4280-b056-1fdcf5fe3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:04.581611 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f2d6-f576-4280-b056-1fdcf5fe3039 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:04.581917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f2d6-f576-4280-b056-1fdcf5fe3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:04.582197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f2d6-f576-4280-b056-1fdcf5fe3039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.586430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65f2d6-f576-4280-b056-1fdcf5fe3039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:04.588164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65f2d6-f576-4280-b056-1fdcf5fe3039 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:04.601580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1144/2307] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:04.605520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:04.623634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afac747-9fa6-400e-b0f9-316fd0b9e7ec admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:04.646704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:04.648887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:04.649192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:04.649484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] PATH_INFO: `/v3/projects/3e381affc6ec47eea24bc9d8f90c0b0e/users/45218e2815cb4346ab41abb09f1596f1/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.673456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e381affc6ec47eea24bc9d8f90c0b0e, user_id=45218e2815cb4346ab41abb09f1596f1, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:04.683945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:04.704821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1164/2308] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:04 2022] PUT /identity/v3/projects/3e381affc6ec47eea24bc9d8f90c0b0e/users/45218e2815cb4346ab41abb09f1596f1/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:30:04.715966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b9611-1bb5-4422-ae54-3f481a9b37a9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:04.716617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b9611-1bb5-4422-ae54-3f481a9b37a9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:04.717049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b9611-1bb5-4422-ae54-3f481a9b37a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:04.791644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3b8b9611-1bb5-4422-ae54-3f481a9b37a9 None None] MFA Rules not processed for user `45218e2815cb4346ab41abb09f1596f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:04.793199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3b8b9611-1bb5-4422-ae54-3f481a9b37a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:04.959605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1145/2309] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:04.975225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:04.979068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:05.103936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:05.146935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec019afd-f809-4979-8d3c-7fd550cd96a8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:05.153440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded81e7f-f136-477d-a146-31111c6895d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:05.154069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81e7f-f136-477d-a146-31111c6895d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:05.154351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81e7f-f136-477d-a146-31111c6895d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:05.154620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81e7f-f136-477d-a146-31111c6895d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:05.189793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded81e7f-f136-477d-a146-31111c6895d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:05.192503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded81e7f-f136-477d-a146-31111c6895d7 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:05.208082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1165/2310] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:13.365866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ddf5f-4c63-4615-96e3-6a56dfd8b596 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:13.366388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ddf5f-4c63-4615-96e3-6a56dfd8b596 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:13.366388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ddf5f-4c63-4615-96e3-6a56dfd8b596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:13.388006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7e6ddf5f-4c63-4615-96e3-6a56dfd8b596 None None] MFA Rules not processed for user `61869276fc7c4162932d04caf497b79d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:13.389204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7e6ddf5f-4c63-4615-96e3-6a56dfd8b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:13.453580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1146/2311] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:14.828373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:14.828907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:14.828907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:14.849108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] MFA Rules not processed for user `1c3a35dcf2ab477d8a5c835be71586f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:14.850319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:14.904203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1166/2312] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:16.328988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef4eb-c0fd-413d-9800-a76373ed36e5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:16.329827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef4eb-c0fd-413d-9800-a76373ed36e5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:16.330896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef4eb-c0fd-413d-9800-a76373ed36e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:16.357334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-969ef4eb-c0fd-413d-9800-a76373ed36e5 None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:16.358553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-969ef4eb-c0fd-413d-9800-a76373ed36e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:16.467041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1147/2313] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:30:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:30:16.482587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:16.487215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:16.585472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef77cc9-19b5-4362-9fcc-598fa895d113 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:16.613301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147301b3-80d1-4d69-844a-ddb68e0bdf43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:16.614326 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147301b3-80d1-4d69-844a-ddb68e0bdf43 service swift] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:16.614815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147301b3-80d1-4d69-844a-ddb68e0bdf43 service swift] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:16.615355 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147301b3-80d1-4d69-844a-ddb68e0bdf43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:16.633670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147301b3-80d1-4d69-844a-ddb68e0bdf43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:16.636310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147301b3-80d1-4d69-844a-ddb68e0bdf43 service swift] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:16.650633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1167/2314] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:30:22.052994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ef4eb-c0fd-413d-9800-a76373ed36e5 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:22.065505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:22.125048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ef4eb-c0fd-413d-9800-a76373ed36e5 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:22.130209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:22.130851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:22.131129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:22.131430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] PATH_INFO: `/v3/users/45218e2815cb4346ab41abb09f1596f1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:22.132581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45218e2815cb4346ab41abb09f1596f1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:22.134496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:22.183509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45218e2815cb4346ab41abb09f1596f1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:22.191998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45218e2815cb4346ab41abb09f1596f1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:22.192759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45218e2815cb4346ab41abb09f1596f1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:22.214679 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45218e2815cb4346ab41abb09f1596f1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:22.222616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45218e2815cb4346ab41abb09f1596f1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:22.228964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1148/2315] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:30:22 2022] DELETE /identity/v3/users/45218e2815cb4346ab41abb09f1596f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:22.233416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:22.233937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:22.234040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:22.253840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:22.255143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:22.325337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1168/2316] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:22.335991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:22.337547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:22.411562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768f56f-526d-451c-b7fe-563081268a04 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:22.418383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b878dc-0ea9-48de-b2c9-04c3a678411c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:22.419100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b878dc-0ea9-48de-b2c9-04c3a678411c service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:22.419971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b878dc-0ea9-48de-b2c9-04c3a678411c service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:22.420293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b878dc-0ea9-48de-b2c9-04c3a678411c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:22.435883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b878dc-0ea9-48de-b2c9-04c3a678411c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:22.437591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b878dc-0ea9-48de-b2c9-04c3a678411c service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:22.449167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1149/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:22.893899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:22.895442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:22.908990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a7dc-6962-4d11-886f-2c352dcc69cc None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:22.913671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:22.914311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:22.914590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:22.914862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] PATH_INFO: `/v3/projects/3e381affc6ec47eea24bc9d8f90c0b0e` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:22.915992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e381affc6ec47eea24bc9d8f90c0b0e)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:22.921662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:22.959793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:23.009116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e381affc6ec47eea24bc9d8f90c0b0e', 'request_id': 'req-556cd0e8-65ee-4849-b69b-a26c5a48939d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:23.029486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e381affc6ec47eea24bc9d8f90c0b0e', 'request_id': 'req-556cd0e8-65ee-4849-b69b-a26c5a48939d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:23.037749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e381affc6ec47eea24bc9d8f90c0b0e', 'request_id': 'req-556cd0e8-65ee-4849-b69b-a26c5a48939d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:23.051449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] The token cache is being invalidate because project 3e381affc6ec47eea24bc9d8f90c0b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:23.051730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:23.052434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-556cd0e8-65ee-4849-b69b-a26c5a48939d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:23.054072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1169/2318] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:22 2022] DELETE /identity/v3/projects/3e381affc6ec47eea24bc9d8f90c0b0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:23.059368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b735-6edf-4bf7-907d-6eeb0e26d94f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.060079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b735-6edf-4bf7-907d-6eeb0e26d94f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.060079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b735-6edf-4bf7-907d-6eeb0e26d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.084069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-3891b735-6edf-4bf7-907d-6eeb0e26d94f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:23.087051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3891b735-6edf-4bf7-907d-6eeb0e26d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:23.118935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:23.152934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1150/2319] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:23.162030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023d7b-5b75-4200-8b45-35444c8573ed None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.162543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023d7b-5b75-4200-8b45-35444c8573ed None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.162820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023d7b-5b75-4200-8b45-35444c8573ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.186476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-65023d7b-5b75-4200-8b45-35444c8573ed None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:23.187503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-65023d7b-5b75-4200-8b45-35444c8573ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:23.205387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891b735-6edf-4bf7-907d-6eeb0e26d94f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:23.212674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1170/2320] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:30:23.216123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891b735-6edf-4bf7-907d-6eeb0e26d94f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:23.221406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:23.222032 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.222316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.222593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.223282 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:30:23.223620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:23.225296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:23.241120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1151/2321] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:30:23.245951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023d7b-5b75-4200-8b45-35444c8573ed None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:23.256792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023d7b-5b75-4200-8b45-35444c8573ed None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:23.262080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:23.262809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.263165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.263443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.264251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:23.266687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:23.300705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1171/2322] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:30:23 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:23.304865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:23.315121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d9c96-ad19-4241-918f-5c661fdb36b4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:23.386463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:23.387242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.387622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.387986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.388834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:23.390861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:23.422197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1152/2323] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:30:23 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:23.426964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:23.437484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4820e-dd84-4bfb-88a2-82821564dcb2 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:23.442133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:23.442752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.443033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.443306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.443952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:23.445590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:23.455461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1172/2324] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:30:23.460388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:23.473191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ec047-85a7-495d-a6b0-5074833e8da2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:23.478242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53aff0-d529-46ab-9de4-3b1f0e678db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:23.478887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53aff0-d529-46ab-9de4-3b1f0e678db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.479174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53aff0-d529-46ab-9de4-3b1f0e678db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.479455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53aff0-d529-46ab-9de4-3b1f0e678db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.480130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53aff0-d529-46ab-9de4-3b1f0e678db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:23.481845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53aff0-d529-46ab-9de4-3b1f0e678db4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:23.495474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1153/2325] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:23.499961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:23.510152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f926c-d596-4787-be72-a79e75684e21 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:23.514850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:23.515496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.515776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.516051 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] PATH_INFO: `/v3/projects/5aa8e2bb68304d66a1c7c31545130ee1/users/c76a858d9abf4818a36045fdcf3fca9a/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.530826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa8e2bb68304d66a1c7c31545130ee1, user_id=c76a858d9abf4818a36045fdcf3fca9a, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:23.534194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:23.547829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1173/2326] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:23 2022] PUT /identity/v3/projects/5aa8e2bb68304d66a1c7c31545130ee1/users/c76a858d9abf4818a36045fdcf3fca9a/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:23.560604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2367c1-fec1-4152-b363-8b06ef84a575 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.560886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2367c1-fec1-4152-b363-8b06ef84a575 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.561251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2367c1-fec1-4152-b363-8b06ef84a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.591585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-1e2367c1-fec1-4152-b363-8b06ef84a575 None None] MFA Rules not processed for user `c76a858d9abf4818a36045fdcf3fca9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:23.592837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1e2367c1-fec1-4152-b363-8b06ef84a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:23.675157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1154/2327] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:23.686136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:23.687835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:23.781227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1341-fabf-49a8-8f43-4c1870bf7faa admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:23.786436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b36e3-85ab-45df-a5ef-0324b0798fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:23.787141 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b36e3-85ab-45df-a5ef-0324b0798fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:23.787423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b36e3-85ab-45df-a5ef-0324b0798fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:23.787700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b36e3-85ab-45df-a5ef-0324b0798fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:23.798762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b36e3-85ab-45df-a5ef-0324b0798fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:23.800216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b36e3-85ab-45df-a5ef-0324b0798fb6 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:23.809419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1174/2328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:26.528580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2367c1-fec1-4152-b363-8b06ef84a575 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:26.562801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:26.601784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2367c1-fec1-4152-b363-8b06ef84a575 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:26.606925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:26.607581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:26.607869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:26.608144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] PATH_INFO: `/v3/users/c76a858d9abf4818a36045fdcf3fca9a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:26.609426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76a858d9abf4818a36045fdcf3fca9a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:26.612026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:26.678891 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76a858d9abf4818a36045fdcf3fca9a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:26.687498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76a858d9abf4818a36045fdcf3fca9a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:26.688172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76a858d9abf4818a36045fdcf3fca9a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:26.704499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76a858d9abf4818a36045fdcf3fca9a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:26.715833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76a858d9abf4818a36045fdcf3fca9a'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:26.725729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1155/2329] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:30:26 2022] DELETE /identity/v3/users/c76a858d9abf4818a36045fdcf3fca9a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:26.730301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:26.730816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:26.730925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:26.765397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:26.767415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:26.822677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:26.852077 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1175/2330] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:26.865486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:26.868528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:26.946488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa9dd-2d5d-481e-8829-30104e091640 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:26.952525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:26.953460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:26.953781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:26.954163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:26.965326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:26.966904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:26.978472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1156/2331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:27.333210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:27.334817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:27.346949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f44d5-9759-4fd0-af1b-4454e76a932f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:27.352702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:27.353422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:27.353705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:27.353980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] PATH_INFO: `/v3/projects/5aa8e2bb68304d66a1c7c31545130ee1` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:27.355344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa8e2bb68304d66a1c7c31545130ee1)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:27.357480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:27.416073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa8e2bb68304d66a1c7c31545130ee1', 'request_id': 'req-73dca07a-de8b-4e70-85de-c7b28bcfb375'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:27.425319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa8e2bb68304d66a1c7c31545130ee1', 'request_id': 'req-73dca07a-de8b-4e70-85de-c7b28bcfb375'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:27.429781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa8e2bb68304d66a1c7c31545130ee1', 'request_id': 'req-73dca07a-de8b-4e70-85de-c7b28bcfb375'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:27.450424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] The token cache is being invalidate because project 5aa8e2bb68304d66a1c7c31545130ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:27.450880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:27.453893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-73dca07a-de8b-4e70-85de-c7b28bcfb375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:27.464344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1176/2332] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:27 2022] DELETE /identity/v3/projects/5aa8e2bb68304d66a1c7c31545130ee1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:27.862559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:27.865916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:27.882708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c779ff-8bc5-411e-a88d-c32bfa0441e8 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:27.948457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:27.962303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:27.962949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:27.963233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:27.963507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] PATH_INFO: `/v3/users/920e7b960eb24fddb848939d83d42b54` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:27.964657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] RBAC: Authorizing `identity:delete_user(user_id=920e7b960eb24fddb848939d83d42b54)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:27.966577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:28.011436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920e7b960eb24fddb848939d83d42b54'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.019439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920e7b960eb24fddb848939d83d42b54'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.020346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920e7b960eb24fddb848939d83d42b54'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.033452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920e7b960eb24fddb848939d83d42b54'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.040807 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920e7b960eb24fddb848939d83d42b54'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.051442 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1157/2333] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:30:27 2022] DELETE /identity/v3/users/920e7b960eb24fddb848939d83d42b54 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:28.053345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:28.053842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:28.053931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:28.077897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:28.079188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:28.159467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1177/2334] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:28.169330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:28.170769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:28.236722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf71eed-a95c-4a02-9902-2b61379a585b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:28.240506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc81fd-9469-43f4-a42d-5ea80f0614a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:28.241196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc81fd-9469-43f4-a42d-5ea80f0614a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:28.241549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc81fd-9469-43f4-a42d-5ea80f0614a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:28.241893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc81fd-9469-43f4-a42d-5ea80f0614a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:28.252306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc81fd-9469-43f4-a42d-5ea80f0614a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:28.253847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc81fd-9469-43f4-a42d-5ea80f0614a3 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:28.263699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1158/2335] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:28.740060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:28.741665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:28.755809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8ef9-8e79-4278-b1e7-98fdeb42a483 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:28.765821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:28.766500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:28.766802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:28.767079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] PATH_INFO: `/v3/projects/10ae7a30565e48a2880a4197704eca38` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:28.768315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ae7a30565e48a2880a4197704eca38)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:28.770258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:28.840471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ae7a30565e48a2880a4197704eca38', 'request_id': 'req-b4dce77c-528d-42ab-8555-199484ee412c'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.851180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ae7a30565e48a2880a4197704eca38', 'request_id': 'req-b4dce77c-528d-42ab-8555-199484ee412c'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.856562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:28.858143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ae7a30565e48a2880a4197704eca38', 'request_id': 'req-b4dce77c-528d-42ab-8555-199484ee412c'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.872580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] The token cache is being invalidate because project 10ae7a30565e48a2880a4197704eca38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:28.873003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.873670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-b4dce77c-528d-42ab-8555-199484ee412c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:28.875421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1178/2336] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:28 2022] DELETE /identity/v3/projects/10ae7a30565e48a2880a4197704eca38 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:30:28.880361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5984d-4734-47da-891b-9b83965e3c5d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:28.880898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5984d-4734-47da-891b-9b83965e3c5d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:28.880898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5984d-4734-47da-891b-9b83965e3c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:28.901534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-49f5984d-4734-47da-891b-9b83965e3c5d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:28.903006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-49f5984d-4734-47da-891b-9b83965e3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:28.969429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1159/2337] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:28.977539 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8c74-c60e-4607-814b-70b3de10abad None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:28.977828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8c74-c60e-4607-814b-70b3de10abad None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:28.978100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8c74-c60e-4607-814b-70b3de10abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:28.999274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-244c8c74-c60e-4607-814b-70b3de10abad None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:29.000879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-244c8c74-c60e-4607-814b-70b3de10abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:29.009605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1179/2338] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:29.014046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5984d-4734-47da-891b-9b83965e3c5d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.024394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5984d-4734-47da-891b-9b83965e3c5d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.029199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.029825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.030106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.030378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.031036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:30:29.031342 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.033003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.042482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:29.046159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1160/2339] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:30:29.051253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8c74-c60e-4607-814b-70b3de10abad None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.060859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8c74-c60e-4607-814b-70b3de10abad None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.065916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.066554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.066834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.067116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.067758 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.069700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.101230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1180/2340] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:29.102632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.114526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392828e-908e-488a-b65f-12db1e38db48 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.176598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.177321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.177589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.177868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.178494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.180453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.204629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1161/2341] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:29.209043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.219416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222fde7-6ddc-41d3-a4b1-3c3cd8b8f699 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.225016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.225701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.226080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.228050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.228762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.230357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.240923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1181/2342] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:29.244869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.255038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9b78-fab0-4247-ae80-e1b957f54cbb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.259793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a6efd-ff71-40e1-a203-525191ca7592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.260435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a6efd-ff71-40e1-a203-525191ca7592 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.260722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a6efd-ff71-40e1-a203-525191ca7592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.260999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a6efd-ff71-40e1-a203-525191ca7592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.261643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a6efd-ff71-40e1-a203-525191ca7592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.263247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a6efd-ff71-40e1-a203-525191ca7592 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.275558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1162/2343] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:29.279717 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.290341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1f57b-f436-493e-aa63-5fb038077941 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.295006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.295668 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.295949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.296230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] PATH_INFO: `/v3/projects/1e72e65a225544f092f20d1ab5e400da/users/ff2befcca3cb433cad63300df5307742/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.313830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e72e65a225544f092f20d1ab5e400da, user_id=ff2befcca3cb433cad63300df5307742, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.316589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.331429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1182/2344] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:29 2022] PUT /identity/v3/projects/1e72e65a225544f092f20d1ab5e400da/users/ff2befcca3cb433cad63300df5307742/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:29.342652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46a928-e8e4-4243-bb10-fbc1edd5f2bf None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.342943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46a928-e8e4-4243-bb10-fbc1edd5f2bf None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.343217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46a928-e8e4-4243-bb10-fbc1edd5f2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.371217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-ab46a928-e8e4-4243-bb10-fbc1edd5f2bf None None] MFA Rules not processed for user `ff2befcca3cb433cad63300df5307742`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:29.372545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ab46a928-e8e4-4243-bb10-fbc1edd5f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:29.435610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1163/2345] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:29.440388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.501562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475246-77b7-4e38-9e71-e07f3a59fb39 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.506303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.506846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.507130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.507407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.508030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.509978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.536356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1183/2346] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:29.540629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46a928-e8e4-4243-bb10-fbc1edd5f2bf None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.552074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46a928-e8e4-4243-bb10-fbc1edd5f2bf None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.607112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.607718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.608001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.608303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.608928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.610848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.625912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:29.633279 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1164/2347] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:29.639448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.655531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93a7a-dcef-4e46-a2c1-a716ebebe0d5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.660862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.661472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.661755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.662029 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.662678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.664287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.674895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1184/2348] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:29.678916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.688663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f45105-830b-4ccb-8902-729c5a33eef1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.693299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114d365-8c46-4435-a8b0-4c889ceeefbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.693894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114d365-8c46-4435-a8b0-4c889ceeefbf admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.694179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114d365-8c46-4435-a8b0-4c889ceeefbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.694452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114d365-8c46-4435-a8b0-4c889ceeefbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.695090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114d365-8c46-4435-a8b0-4c889ceeefbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.696740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114d365-8c46-4435-a8b0-4c889ceeefbf admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.707010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1165/2349] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:29.710733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.721582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba99837-022d-4759-88b4-39384356bd4d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.726164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.726802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.727111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.727386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] PATH_INFO: `/v3/projects/f910890a6c384134a026aa7a449e118d/users/c6afc7962a3e4172bd009ea0f2da7769/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.741351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f910890a6c384134a026aa7a449e118d, user_id=c6afc7962a3e4172bd009ea0f2da7769, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.744003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.756835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1185/2350] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:29 2022] PUT /identity/v3/projects/f910890a6c384134a026aa7a449e118d/users/c6afc7962a3e4172bd009ea0f2da7769/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:29.767623 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091cd5d-656f-4649-b9d1-5441831e5254 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.767908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091cd5d-656f-4649-b9d1-5441831e5254 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.768187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091cd5d-656f-4649-b9d1-5441831e5254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.795963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c091cd5d-656f-4649-b9d1-5441831e5254 None None] MFA Rules not processed for user `c6afc7962a3e4172bd009ea0f2da7769`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:29.797212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c091cd5d-656f-4649-b9d1-5441831e5254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:29.866216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1166/2351] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:29.870942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.911742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:29.932576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d66bc0-b0d9-42d9-baf8-579890d50bdd admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:29.937247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:29.937842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:29.938130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:29.938406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:29.939537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:29.941464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:29.967017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1186/2352] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:29.971127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091cd5d-656f-4649-b9d1-5441831e5254 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:29.981800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091cd5d-656f-4649-b9d1-5441831e5254 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:30.041471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:30.042005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:30.042283 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:30.042552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:30.043178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:30.045191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:30.067287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1167/2353] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:30:29 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:30.071353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:30.082356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827203-1c88-40e7-a88b-297303d37ac2 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:30.087084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:30.087693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:30.088013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:30.088318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:30.089013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:30.090651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:30.101496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1187/2354] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:30.105752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:30.115601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9055a-466c-4d0f-8c88-e1fd59edaf1b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:30.120238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:30.120919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:30.121200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:30.121477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] PATH_INFO: `/v3/projects/272b7a1565f04876a431974958747435/users/b0cf86349bc24ef79ad09960350fa8af/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:30.136499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272b7a1565f04876a431974958747435, user_id=b0cf86349bc24ef79ad09960350fa8af, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:30.139165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:30.152173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1168/2355] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:30 2022] PUT /identity/v3/projects/272b7a1565f04876a431974958747435/users/b0cf86349bc24ef79ad09960350fa8af/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:30.156083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:30.166197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4454df-7d3d-4bd4-9fb1-2632f97295f0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:30.222851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6748cb-3890-4aad-9215-429c34f1e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:30.223469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6748cb-3890-4aad-9215-429c34f1e699 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:30.223873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6748cb-3890-4aad-9215-429c34f1e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:30.224158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6748cb-3890-4aad-9215-429c34f1e699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:30.224889 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6748cb-3890-4aad-9215-429c34f1e699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:30.226488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6748cb-3890-4aad-9215-429c34f1e699 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:30.240222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1188/2356] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:30:30.241472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:30.253488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2cb7d-0424-40ae-b580-e603f3372159 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:30.258215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:30.258892 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:30.259176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:30.259487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] PATH_INFO: `/v3/projects/272b7a1565f04876a431974958747435/users/b0cf86349bc24ef79ad09960350fa8af/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:30.261463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=272b7a1565f04876a431974958747435, user_id=b0cf86349bc24ef79ad09960350fa8af, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:30.264126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:30.275939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1169/2357] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:30 2022] PUT /identity/v3/projects/272b7a1565f04876a431974958747435/users/b0cf86349bc24ef79ad09960350fa8af/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:30.286495 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:30.286781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:30.287054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:30.318523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] MFA Rules not processed for user `b0cf86349bc24ef79ad09960350fa8af`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:30.319653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:30.391594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1189/2358] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:30.404058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:30.405991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:30.441870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:30.478239 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da45e2-873f-46f1-b9bb-748379b56aba admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:30.482089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:30.482698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:30.482984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:30.483260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:30.542941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:30.544463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:30.553767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1170/2359] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:32.134244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:32.135776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:32.149045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6935e-a4b9-4b90-879b-792e1dab4b4d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:32.153171 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:32.154024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:32.154472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:32.154988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:32.198474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:32.231905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:32.233392 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:32.243871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1190/2360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:32.825765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:32.836678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02eb7b-6f49-41c8-8230-ce89088282b6 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:32.858986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b7b01-b99c-4f87-aa0f-daa07d7787e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:32.858986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b7b01-b99c-4f87-aa0f-daa07d7787e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:32.858986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b7b01-b99c-4f87-aa0f-daa07d7787e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:32.858986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b7b01-b99c-4f87-aa0f-daa07d7787e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:32.873577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b7b01-b99c-4f87-aa0f-daa07d7787e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:32.875601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b7b01-b99c-4f87-aa0f-daa07d7787e2 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:32.889278 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1171/2361] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:37.072705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:37.140599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a83b-34a2-48c6-b467-2007ac33394a service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:37.145137 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:37.145764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:37.146039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:37.146308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] PATH_INFO: `/v3/users/ff2befcca3cb433cad63300df5307742` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:37.147424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2befcca3cb433cad63300df5307742)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:37.149441 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:37.200749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2befcca3cb433cad63300df5307742'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.210434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2befcca3cb433cad63300df5307742'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.211087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2befcca3cb433cad63300df5307742'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.220878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2befcca3cb433cad63300df5307742'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.235241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2befcca3cb433cad63300df5307742'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.243490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1191/2362] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:30:37 2022] DELETE /identity/v3/users/ff2befcca3cb433cad63300df5307742 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:37.248232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:37.248806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:37.248806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:37.269523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:37.270716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:37.346569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1172/2363] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:30:37.356352 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:37.357796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:37.428076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4316c9b-14d7-43b5-b70f-fd0979e472b8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:37.431952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:37.432621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:37.433010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:37.433292 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:37.441379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:37.446601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:37.448347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:37.461178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1192/2364] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:37.780321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:37.782020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:37.799544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eed4-ca4f-48ca-bd02-0c5a217db72f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:37.804799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:37.805266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:37.805538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:37.805929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] PATH_INFO: `/v3/projects/1e72e65a225544f092f20d1ab5e400da` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:37.806945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e72e65a225544f092f20d1ab5e400da)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:37.808941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:37.873418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e72e65a225544f092f20d1ab5e400da', 'request_id': 'req-e7091320-de01-42c9-881f-bcfd45f8b3a0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.880387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e72e65a225544f092f20d1ab5e400da', 'request_id': 'req-e7091320-de01-42c9-881f-bcfd45f8b3a0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.891317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e72e65a225544f092f20d1ab5e400da', 'request_id': 'req-e7091320-de01-42c9-881f-bcfd45f8b3a0'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.895525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:37.925196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] The token cache is being invalidate because project 1e72e65a225544f092f20d1ab5e400da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:37.925796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.926884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:37.928978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1173/2365] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:37 2022] DELETE /identity/v3/projects/1e72e65a225544f092f20d1ab5e400da => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:37.933276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:37.946140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc50d5-5ce0-4b65-8431-35d045ac436f service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:38.008575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:38.009482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:38.009762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:38.010038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] PATH_INFO: `/v3/users/c6afc7962a3e4172bd009ea0f2da7769` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:38.011350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6afc7962a3e4172bd009ea0f2da7769)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:38.013436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:38.064841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6afc7962a3e4172bd009ea0f2da7769'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.073322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6afc7962a3e4172bd009ea0f2da7769'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.074064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6afc7962a3e4172bd009ea0f2da7769'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.083201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6afc7962a3e4172bd009ea0f2da7769'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.099680 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6afc7962a3e4172bd009ea0f2da7769'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.109633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1193/2366] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:30:37 2022] DELETE /identity/v3/users/c6afc7962a3e4172bd009ea0f2da7769 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:38.454922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:38.456581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:38.483762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7091320-de01-42c9-881f-bcfd45f8b3a0 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:38.566962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:38.567811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:38.572135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:38.572135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] PATH_INFO: `/v3/projects/f910890a6c384134a026aa7a449e118d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:38.572135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f910890a6c384134a026aa7a449e118d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:38.572135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:38.637667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f910890a6c384134a026aa7a449e118d', 'request_id': 'req-66e980c0-1998-45e3-b9f8-f8999962d1ac'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.645708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f910890a6c384134a026aa7a449e118d', 'request_id': 'req-66e980c0-1998-45e3-b9f8-f8999962d1ac'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.658118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f910890a6c384134a026aa7a449e118d', 'request_id': 'req-66e980c0-1998-45e3-b9f8-f8999962d1ac'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.675243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] The token cache is being invalidate because project f910890a6c384134a026aa7a449e118d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:38.676000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.677039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.682225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1174/2367] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:38 2022] DELETE /identity/v3/projects/f910890a6c384134a026aa7a449e118d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:38.683647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:38.687433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:38.705204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5295b-e19d-4901-9585-11a32e0e3a51 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:38.785673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:38.786421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:38.786771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:38.787117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] PATH_INFO: `/v3/users/b0cf86349bc24ef79ad09960350fa8af` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:38.789254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cf86349bc24ef79ad09960350fa8af)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:38.793033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:38.818670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:38.877002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cf86349bc24ef79ad09960350fa8af'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.886174 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cf86349bc24ef79ad09960350fa8af'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.886856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cf86349bc24ef79ad09960350fa8af'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.898959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cf86349bc24ef79ad09960350fa8af'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.926806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-5e17738b-a282-43e6-8882-2005ce9c45cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cf86349bc24ef79ad09960350fa8af'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:38.942050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1194/2368] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:30:38 2022] DELETE /identity/v3/users/b0cf86349bc24ef79ad09960350fa8af => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:39.628649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:39.630403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:39.649674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e980c0-1998-45e3-b9f8-f8999962d1ac admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:39.708658 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:39.709292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:39.709570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:39.709844 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] PATH_INFO: `/v3/projects/272b7a1565f04876a431974958747435` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:39.710961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=272b7a1565f04876a431974958747435)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:39.712902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:39.745205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:39.765852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272b7a1565f04876a431974958747435', 'request_id': 'req-32d3afb2-68ef-4320-a2f0-9e532c036b1b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:39.773077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272b7a1565f04876a431974958747435', 'request_id': 'req-32d3afb2-68ef-4320-a2f0-9e532c036b1b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:39.779779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272b7a1565f04876a431974958747435', 'request_id': 'req-32d3afb2-68ef-4320-a2f0-9e532c036b1b'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:39.796942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] The token cache is being invalidate because project 272b7a1565f04876a431974958747435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:30:39.797235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:39.797916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-32d3afb2-68ef-4320-a2f0-9e532c036b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:30:39.799652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1175/2369] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:30:39 2022] DELETE /identity/v3/projects/272b7a1565f04876a431974958747435 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:39.804504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9e35e-7533-46b8-b88c-7a4c256fa8d5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:39.804974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9e35e-7533-46b8-b88c-7a4c256fa8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:39.805076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9e35e-7533-46b8-b88c-7a4c256fa8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:39.832097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-63b9e35e-7533-46b8-b88c-7a4c256fa8d5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:39.833421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-63b9e35e-7533-46b8-b88c-7a4c256fa8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:39.925684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1195/2370] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:39.938967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f98a3-e4b8-49ac-98cc-6b7ae92a4ac6 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:39.939259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f98a3-e4b8-49ac-98cc-6b7ae92a4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:39.939539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f98a3-e4b8-49ac-98cc-6b7ae92a4ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:39.959969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-216f98a3-e4b8-49ac-98cc-6b7ae92a4ac6 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:39.961209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-216f98a3-e4b8-49ac-98cc-6b7ae92a4ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:39.969678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1176/2371] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:39.974566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9e35e-7533-46b8-b88c-7a4c256fa8d5 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:39.983998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9e35e-7533-46b8-b88c-7a4c256fa8d5 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:39.989196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:39.990014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:39.990301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:39.990576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:39.991340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:30:39.991647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:39.993744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:40.006964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1196/2372] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:30:40.011106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f98a3-e4b8-49ac-98cc-6b7ae92a4ac6 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:40.022677 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f98a3-e4b8-49ac-98cc-6b7ae92a4ac6 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:40.029141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:40.029881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:40.030664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:40.031046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:40.033008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:40.035005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:40.070558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1177/2373] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:30:40 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:30:40.074379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:40.086038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41248a-c3eb-48a9-b977-0da9b6483122 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:40.149186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:40.149798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:40.150083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:40.150362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:40.150993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:40.153052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:40.180897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1197/2374] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:30:40 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:30:40.182479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:40.194111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76149ddf-5d9a-460c-8bdc-b61816cc6930 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:40.201725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:40.202684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:40.203030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:40.203664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:40.205210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:40.207320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:40.218722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1178/2375] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:30:40.222934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:40.233599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0281-c69c-40dc-8b89-ea75bd5ff8d4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:40.239323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1401b-6295-4d40-8b14-36fe77f608d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:40.240325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1401b-6295-4d40-8b14-36fe77f608d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:40.240325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1401b-6295-4d40-8b14-36fe77f608d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:40.240592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1401b-6295-4d40-8b14-36fe77f608d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:40.241170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1401b-6295-4d40-8b14-36fe77f608d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:40.242809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1401b-6295-4d40-8b14-36fe77f608d8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:40.245221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:40.257000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1198/2376] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:30:40.260264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:40.271168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca862-8e38-46f2-9189-0b6bd4dfbb23 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:40.276389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:40.277153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:40.277535 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:40.277873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] PATH_INFO: `/v3/projects/f5bc71012eae4d2e8b8e06457ed1b0ee/users/6eea85f2e6a94353a032953fe5040188/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:40.295820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bc71012eae4d2e8b8e06457ed1b0ee, user_id=6eea85f2e6a94353a032953fe5040188, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:40.299358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:40.314886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1179/2377] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:30:40 2022] PUT /identity/v3/projects/f5bc71012eae4d2e8b8e06457ed1b0ee/users/6eea85f2e6a94353a032953fe5040188/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:30:40.325695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2be58-8dfd-425e-811f-bbd1d39daafd None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:40.326065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2be58-8dfd-425e-811f-bbd1d39daafd None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:40.326411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2be58-8dfd-425e-811f-bbd1d39daafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:40.366928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a8a2be58-8dfd-425e-811f-bbd1d39daafd None None] MFA Rules not processed for user `6eea85f2e6a94353a032953fe5040188`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:40.368249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a8a2be58-8dfd-425e-811f-bbd1d39daafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:40.433610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1199/2378] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:40.445077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:40.446754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:40.505895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40956b-3e5c-42d9-9ced-24b64acd0355 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:40.512102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b9dd5-7a15-4b1f-98e5-c19f432c8559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:40.512251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9dd5-7a15-4b1f-98e5-c19f432c8559 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:40.512512 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9dd5-7a15-4b1f-98e5-c19f432c8559 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:40.512795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9dd5-7a15-4b1f-98e5-c19f432c8559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:40.521916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9dd5-7a15-4b1f-98e5-c19f432c8559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:40.523356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9dd5-7a15-4b1f-98e5-c19f432c8559 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:40.533201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1180/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:41.927890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:41.928485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:41.928485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:41.950279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] MFA Rules not processed for user `6eea85f2e6a94353a032953fe5040188`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:41.951493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:41.959351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1200/2380] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:48.127400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39082ab-fe3c-4772-a941-403dbb705d23 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:48.127400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39082ab-fe3c-4772-a941-403dbb705d23 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:48.127400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39082ab-fe3c-4772-a941-403dbb705d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:48.135564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e39082ab-fe3c-4772-a941-403dbb705d23 None None] MFA Rules not processed for user `686afeec87d34ad8a547d81f25de2428`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:48.137003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e39082ab-fe3c-4772-a941-403dbb705d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:48.213182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:48.224015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1181/2381] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:30:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:51.944048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=36 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:55.654951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:55.657129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:55.715003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bc951-2963-4f8d-be00-c384149bbac1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:55.718527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:55.719628 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:55.719912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:55.720175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:55.721917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:55.786770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:55.788216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:55.798535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1201/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:30:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:30:58.227141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:30:58.490290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:58.490592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:58.490972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:58.514710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:30:58.515896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:58.591587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1182/2383] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:30:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:30:58.608499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:30:58.611569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:30:58.740975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05af46-db85-4009-bfa9-ce81228b1633 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:30:58.751482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609dda6-f385-4d6a-854e-994dde9b66c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:30:58.752439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609dda6-f385-4d6a-854e-994dde9b66c5 service swift] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:30:58.752848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609dda6-f385-4d6a-854e-994dde9b66c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:30:58.756721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609dda6-f385-4d6a-854e-994dde9b66c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:30:58.768734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609dda6-f385-4d6a-854e-994dde9b66c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:30:58.772471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609dda6-f385-4d6a-854e-994dde9b66c5 service swift] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:30:58.787070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1202/2384] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:30:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:31:08.579366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=25 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:08.779137 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=82 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:14.367031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:14.369290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:14.474237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6c01-a5a1-4ed9-8b09-5fb5c247b463 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:14.482206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:14.482833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:14.483121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:14.483393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:14.485292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:14.505086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:14.507121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:14.518733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1183/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:16.928985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5846d0-6662-4c0c-a41d-43f641eddaca None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:16.929540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5846d0-6662-4c0c-a41d-43f641eddaca None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:16.929540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5846d0-6662-4c0c-a41d-43f641eddaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:16.950431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8a5846d0-6662-4c0c-a41d-43f641eddaca None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:16.951659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8a5846d0-6662-4c0c-a41d-43f641eddaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:16.959880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1203/2386] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:31:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:16.971978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:16.983306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8d086-7b97-43a5-9f35-ee5451d37add service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:16.989384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:16.990212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:16.990644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:16.991077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:17.007354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:17.010369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:17.026743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1184/2387] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:31:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:31:17.209043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275b0e-6488-4bdd-b821-53300dc67ffe None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:17.209574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275b0e-6488-4bdd-b821-53300dc67ffe None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:17.210012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275b0e-6488-4bdd-b821-53300dc67ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:17.238719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-87275b0e-6488-4bdd-b821-53300dc67ffe None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:17.242948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-87275b0e-6488-4bdd-b821-53300dc67ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:17.252105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1204/2388] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 21 05:31:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:17.268434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:17.279476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b310-2cb4-4055-a5b8-230c7033a2f1 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:17.289450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:17.290315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:17.290812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:17.291458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:17.303676 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:17.305731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:17.319644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1185/2389] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:31:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:31:17.773795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42c13-94ea-4f9b-bfbd-0ac302e7333d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:17.774085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42c13-94ea-4f9b-bfbd-0ac302e7333d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:17.774365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42c13-94ea-4f9b-bfbd-0ac302e7333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:17.799976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-47d42c13-94ea-4f9b-bfbd-0ac302e7333d None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:17.801821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-47d42c13-94ea-4f9b-bfbd-0ac302e7333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:17.831598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:17.836761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1205/2390] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 21 05:31:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:17.852518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a9bd2-373e-4491-b6d9-2d4170c977af service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:17.886682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:17.893126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:17.893435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:17.893696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:17.922937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:17.924597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:17.933781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1186/2391] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:31:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:31:18.318339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e240c4-17fb-48d5-8f81-3c583050f0d6 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:18.319016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e240c4-17fb-48d5-8f81-3c583050f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:18.319016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e240c4-17fb-48d5-8f81-3c583050f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:18.338937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-41e240c4-17fb-48d5-8f81-3c583050f0d6 None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:18.340131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-41e240c4-17fb-48d5-8f81-3c583050f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:18.347872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1206/2392] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:31:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:31:18.360000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:18.370465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bdfe1-e56f-4c8f-a468-82df93e4cc67 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:18.376207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:18.376889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:18.377174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:18.377447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:18.385394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:18.387159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:18.396141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1187/2393] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:31:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:31:18.731356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:18.731641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:18.731918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:18.751795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:18.753035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:18.760214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1207/2394] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 21 05:31:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:18.772369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:18.783578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e380e4-a487-4647-be4a-cfa3e87452d1 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:18.788607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:18.789203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:18.789483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:18.789754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:18.798597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:18.800196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:18.808781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1188/2395] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:31:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:31:19.907897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:19.909559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:19.975505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0f99a-8464-498f-8ad0-3b73fc349d2d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:19.980050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:19.980720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:19.981003 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:19.981279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] PATH_INFO: `/v3/users/1c3a35dcf2ab477d8a5c835be71586f5` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:19.982419 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3a35dcf2ab477d8a5c835be71586f5)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:19.984433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.031598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3a35dcf2ab477d8a5c835be71586f5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.038804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3a35dcf2ab477d8a5c835be71586f5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.039471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3a35dcf2ab477d8a5c835be71586f5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.046545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3a35dcf2ab477d8a5c835be71586f5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.058489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-2171845c-4097-41cd-9891-d95212aefa52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3a35dcf2ab477d8a5c835be71586f5'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.065006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1208/2396] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:31:19 2022] DELETE /identity/v3/users/1c3a35dcf2ab477d8a5c835be71586f5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:20.236685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.250980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3b677-4aba-4c5e-aad5-f6518b11ffb1 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:20.324223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:20.324894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.325178 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.325458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] PATH_INFO: `/v3/projects/47b34a0024eb4bd3a600c4954eaa527e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.326600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b34a0024eb4bd3a600c4954eaa527e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:20.328627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.362286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:20.385149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b34a0024eb4bd3a600c4954eaa527e', 'request_id': 'req-57a973f5-3362-445c-8829-ee91469787fd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.391772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b34a0024eb4bd3a600c4954eaa527e', 'request_id': 'req-57a973f5-3362-445c-8829-ee91469787fd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.398030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b34a0024eb4bd3a600c4954eaa527e', 'request_id': 'req-57a973f5-3362-445c-8829-ee91469787fd'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.410340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] The token cache is being invalidate because project 47b34a0024eb4bd3a600c4954eaa527e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:31:20.410631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.411247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-57a973f5-3362-445c-8829-ee91469787fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:20.412783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1189/2397] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:31:20 2022] DELETE /identity/v3/projects/47b34a0024eb4bd3a600c4954eaa527e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:20.419008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff949a8-122f-469f-878c-e1f132b87fe7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.419300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff949a8-122f-469f-878c-e1f132b87fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.419604 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff949a8-122f-469f-878c-e1f132b87fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.440086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7ff949a8-122f-469f-878c-e1f132b87fe7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:20.441336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7ff949a8-122f-469f-878c-e1f132b87fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:20.486100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:20.504975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1209/2398] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:20.513682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e7d7-54db-4635-9639-5d38fb9b95b9 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.513974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e7d7-54db-4635-9639-5d38fb9b95b9 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.514257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e7d7-54db-4635-9639-5d38fb9b95b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.534320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cdd4e7d7-54db-4635-9639-5d38fb9b95b9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:20.535467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cdd4e7d7-54db-4635-9639-5d38fb9b95b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:20.543348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1190/2399] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:20.548424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff949a8-122f-469f-878c-e1f132b87fe7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.557978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff949a8-122f-469f-878c-e1f132b87fe7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:20.567705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:20.568347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.568641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.568917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.569569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:31:20.569872 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:20.571466 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.583701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1210/2400] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:31:20.588070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4e7d7-54db-4635-9639-5d38fb9b95b9 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.597422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4e7d7-54db-4635-9639-5d38fb9b95b9 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:20.602211 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:20.602847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.603132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.603405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.604029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:20.605977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.633510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1191/2401] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:31:20 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:31:20.637595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.649480 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea11db9-0a6b-48ca-8d50-0284e54fd7a4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:20.707689 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:20.708319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.708599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.708867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.709486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:20.711415 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.731890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1211/2402] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:31:20 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:31:20.736059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.746373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328713-6c92-4b78-9774-e651f1482a1f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:20.751500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:20.752096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.752419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.752693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.753330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:20.755402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.769587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1192/2403] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:31:20.770583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.782763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74996951-c586-4403-9f4f-4589ebae1241 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:20.790900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7578325-89f2-4dab-a8fe-0dffc7b9b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:20.791505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7578325-89f2-4dab-a8fe-0dffc7b9b882 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.791795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7578325-89f2-4dab-a8fe-0dffc7b9b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.792069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7578325-89f2-4dab-a8fe-0dffc7b9b882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.792763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7578325-89f2-4dab-a8fe-0dffc7b9b882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:20.794365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7578325-89f2-4dab-a8fe-0dffc7b9b882 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.809305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1212/2404] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:31:20.810741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.821040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633db31-e27a-4fcc-ae1d-71162adaaae5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:20.826069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:20.826837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.827257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.828163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] PATH_INFO: `/v3/projects/023c30e5231b467a8a95f4950d801ab1/users/ee81958700a2487aaa98ae4c832b58ad/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.851565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023c30e5231b467a8a95f4950d801ab1, user_id=ee81958700a2487aaa98ae4c832b58ad, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:20.854443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:20.869932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1193/2405] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:31:20 2022] PUT /identity/v3/projects/023c30e5231b467a8a95f4950d801ab1/users/ee81958700a2487aaa98ae4c832b58ad/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:20.938437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:20.938904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:20.939020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:20.954749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:20.956947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:20.970300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] MFA Rules not processed for user `ee81958700a2487aaa98ae4c832b58ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:20.971519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.036223 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40fd5a-6c6f-43a0-ada9-ea6838ee2ed7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.040837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.041470 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.041757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.042033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] PATH_INFO: `/v3/users/6eea85f2e6a94353a032953fe5040188` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.043177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eea85f2e6a94353a032953fe5040188)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:21.044167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1213/2406] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:21.045183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:21.054961 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:21.056339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.095576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eea85f2e6a94353a032953fe5040188'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.099914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=14,keystone:SELECT=82,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:21.104568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eea85f2e6a94353a032953fe5040188'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.105567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eea85f2e6a94353a032953fe5040188'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.108492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:21.119959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eea85f2e6a94353a032953fe5040188'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.122363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0edad0-58f9-46a6-a481-919cd79a1fde None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.126551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.127161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.127443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.127567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-41c2a735-9c26-41da-ad2d-6b5b9a73e9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eea85f2e6a94353a032953fe5040188'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.127721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.129966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.133645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1194/2407] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:31:20 2022] DELETE /identity/v3/users/6eea85f2e6a94353a032953fe5040188 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:21.138362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.138675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.138953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.145765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:21.147436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:21.157518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1214/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:31:21.159639 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:21.160945 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.220253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1195/2409] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:31:21.230131 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:21.231551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.304909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117bbb8-5da2-43f2-84d0-e4df6f9f92f9 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.356362 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ba306-fadb-4ad9-b6b2-e9d8cf95b7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.356977 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba306-fadb-4ad9-b6b2-e9d8cf95b7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.357261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba306-fadb-4ad9-b6b2-e9d8cf95b7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.357541 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba306-fadb-4ad9-b6b2-e9d8cf95b7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.367998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ba306-fadb-4ad9-b6b2-e9d8cf95b7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:21.369752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ba306-fadb-4ad9-b6b2-e9d8cf95b7f6 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:21.379901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1215/2410] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:21.561261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:21.562811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.575080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e47f58-d1a7-4f92-8702-64b60d5b117c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.580304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.580948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.581231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.581507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] PATH_INFO: `/v3/projects/f5bc71012eae4d2e8b8e06457ed1b0ee` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.582692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bc71012eae4d2e8b8e06457ed1b0ee)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:21.584655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:21.641674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bc71012eae4d2e8b8e06457ed1b0ee', 'request_id': 'req-45a2d9be-3084-425d-a853-254e3e83cf14'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.649381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bc71012eae4d2e8b8e06457ed1b0ee', 'request_id': 'req-45a2d9be-3084-425d-a853-254e3e83cf14'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.656388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bc71012eae4d2e8b8e06457ed1b0ee', 'request_id': 'req-45a2d9be-3084-425d-a853-254e3e83cf14'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.668777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] The token cache is being invalidate because project f5bc71012eae4d2e8b8e06457ed1b0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:31:21.669060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.669774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-45a2d9be-3084-425d-a853-254e3e83cf14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:21.672242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1196/2411] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:31:21 2022] DELETE /identity/v3/projects/f5bc71012eae4d2e8b8e06457ed1b0ee => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:21.677339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b540d1-43b3-4d3a-9e45-d03f36c37cf8 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.677654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b540d1-43b3-4d3a-9e45-d03f36c37cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.677954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b540d1-43b3-4d3a-9e45-d03f36c37cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.697994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-65b540d1-43b3-4d3a-9e45-d03f36c37cf8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:21.699216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-65b540d1-43b3-4d3a-9e45-d03f36c37cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.757211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1216/2412] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:21.764884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c740-7621-4dc9-833b-0f26c0376011 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.765737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c740-7621-4dc9-833b-0f26c0376011 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.766009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c740-7621-4dc9-833b-0f26c0376011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.786001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2c09c740-7621-4dc9-833b-0f26c0376011 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:21.787189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2c09c740-7621-4dc9-833b-0f26c0376011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:21.794879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1197/2413] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:21.799017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b540d1-43b3-4d3a-9e45-d03f36c37cf8 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:21.808804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b540d1-43b3-4d3a-9e45-d03f36c37cf8 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.813830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.814422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.814705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.814979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.815622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:31:21.815929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:21.817606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:21.829934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1217/2414] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:31:21.833912 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c740-7621-4dc9-833b-0f26c0376011 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:21.843049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c740-7621-4dc9-833b-0f26c0376011 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.847721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.848354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.848638 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.848915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.849555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:21.851466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:21.879630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1198/2415] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:31:21 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:31:21.883747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:21.894193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cb5cf-2e8a-418d-8eb0-74326a76ac58 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.923378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:21.953379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.954046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.954260 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.954536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:21.955170 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:21.957133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:21.978007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1218/2416] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:31:21 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:31:21.982387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:21.992855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd14abf-e4a5-4e9a-ae4e-837116681213 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:21.997742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:21.998363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:21.998653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:21.998932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:22.000098 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:22.001852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:22.012405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1199/2417] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:31:22.016988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:22.027456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564065e-23a7-4d19-a97d-b5a2a6496fe1 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:22.032936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b500f-8c12-4e29-8da8-c863f29cfc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:22.033553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b500f-8c12-4e29-8da8-c863f29cfc4d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:22.033863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b500f-8c12-4e29-8da8-c863f29cfc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:22.034621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b500f-8c12-4e29-8da8-c863f29cfc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:22.034807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b500f-8c12-4e29-8da8-c863f29cfc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:22.036838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b500f-8c12-4e29-8da8-c863f29cfc4d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:22.047778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1219/2418] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:31:22.052086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:22.062690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433e49-ddfc-4d4c-b0e3-8fa96960aac6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:22.067521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:22.068168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:22.068486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:22.068762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] PATH_INFO: `/v3/projects/9b5df8d8fe3046f59029afa7b8ffd004/users/9f08e2e50d214193946f79da089e488c/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:22.080854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:22.085573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5df8d8fe3046f59029afa7b8ffd004, user_id=9f08e2e50d214193946f79da089e488c, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:22.088774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:22.103664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1200/2419] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:31:22 2022] PUT /identity/v3/projects/9b5df8d8fe3046f59029afa7b8ffd004/users/9f08e2e50d214193946f79da089e488c/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:22.109503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe214f-f09b-49bf-b5f8-af328a2a4309 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:22.109861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe214f-f09b-49bf-b5f8-af328a2a4309 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:22.110204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe214f-f09b-49bf-b5f8-af328a2a4309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:22.130697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d5fe214f-f09b-49bf-b5f8-af328a2a4309 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:22.131988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d5fe214f-f09b-49bf-b5f8-af328a2a4309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:22.192344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1220/2420] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:22.202897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:22.205201 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:22.263088 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34638640-42bd-4d4c-97d0-3ddc1bfc1916 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:22.266749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:22.267350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:22.267629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:22.267901 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:22.276643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:22.278056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:22.287329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1201/2421] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:22.985215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ad726-c710-43e9-a2e9-1f25c5f03ba7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:22.985897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ad726-c710-43e9-a2e9-1f25c5f03ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:22.985897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ad726-c710-43e9-a2e9-1f25c5f03ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:23.020971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-952ad726-c710-43e9-a2e9-1f25c5f03ba7 None None] MFA Rules not processed for user `9f08e2e50d214193946f79da089e488c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:23.022884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-952ad726-c710-43e9-a2e9-1f25c5f03ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:23.090944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1221/2422] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:31:23.102763 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:23.104176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:23.167050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7fb2-910c-414c-8797-510c834c2cfd service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:23.171230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4123b-935a-43ac-bb7f-e0c4ff6959a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:23.171860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4123b-935a-43ac-bb7f-e0c4ff6959a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:23.172144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4123b-935a-43ac-bb7f-e0c4ff6959a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:23.172457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4123b-935a-43ac-bb7f-e0c4ff6959a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:23.181756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4123b-935a-43ac-bb7f-e0c4ff6959a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:23.183197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4123b-935a-43ac-bb7f-e0c4ff6959a7 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:23.192454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1202/2423] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:24.574013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:24.575291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:24.575745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:24.596683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] MFA Rules not processed for user `9f08e2e50d214193946f79da089e488c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:24.597923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:24.610261 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1222/2424] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:32.012991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:32.013540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:32.013686 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:32.034966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:32.036316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:32.095042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1203/2425] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:31:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:32.107283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:32.108788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:32.150570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:32.191724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97ffa-c028-4650-aa41-c96298b4b2ae None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:32.196688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4066fd-fc62-4691-b538-b51aff4d58e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:32.197298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4066fd-fc62-4691-b538-b51aff4d58e5 service swift] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:32.197576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4066fd-fc62-4691-b538-b51aff4d58e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:32.197845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4066fd-fc62-4691-b538-b51aff4d58e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:32.206923 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4066fd-fc62-4691-b538-b51aff4d58e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:32.208531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4066fd-fc62-4691-b538-b51aff4d58e5 service swift] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:32.216590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1223/2426] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:31:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:31:32.355267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:32.356914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:32.375871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd74bf-8721-4a42-8315-6ea3b90f9251 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:32.382578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:32.384380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:32.384795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:32.385665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] PATH_INFO: `/v3/users/ee81958700a2487aaa98ae4c832b58ad` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:32.386914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee81958700a2487aaa98ae4c832b58ad)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:32.389494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:32.458304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:32.482727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee81958700a2487aaa98ae4c832b58ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:32.496830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee81958700a2487aaa98ae4c832b58ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:32.497131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee81958700a2487aaa98ae4c832b58ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:32.529662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee81958700a2487aaa98ae4c832b58ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:32.545726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee81958700a2487aaa98ae4c832b58ad'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:32.559286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1204/2427] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:31:32 2022] DELETE /identity/v3/users/ee81958700a2487aaa98ae4c832b58ad => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:32.564095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:32.564416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:32.564699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:32.597915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:32.599784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:32.698193 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1224/2428] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:32.708345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:32.709605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:32.782554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303684ee-8f2f-44f6-b1ea-a4009d52801f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:32.787864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76943e1c-29c7-4562-bb13-6a6fdb349d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:32.788557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76943e1c-29c7-4562-bb13-6a6fdb349d47 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:32.788841 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76943e1c-29c7-4562-bb13-6a6fdb349d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:32.789115 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76943e1c-29c7-4562-bb13-6a6fdb349d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:32.799541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76943e1c-29c7-4562-bb13-6a6fdb349d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:32.801039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76943e1c-29c7-4562-bb13-6a6fdb349d47 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:32.816585 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1205/2429] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:33.162058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:33.163627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:33.204609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c82b-ec81-4da9-b6ae-aa2034093a78 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:33.214988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:33.215643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:33.215933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:33.216211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] PATH_INFO: `/v3/projects/023c30e5231b467a8a95f4950d801ab1` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:33.217391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023c30e5231b467a8a95f4950d801ab1)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:33.224742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:33.276633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023c30e5231b467a8a95f4950d801ab1', 'request_id': 'req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:33.285503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023c30e5231b467a8a95f4950d801ab1', 'request_id': 'req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:33.292456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023c30e5231b467a8a95f4950d801ab1', 'request_id': 'req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:33.313411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] The token cache is being invalidate because project 023c30e5231b467a8a95f4950d801ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:31:33.313730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:33.314525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-27796d74-5d3b-4d43-bdf2-0c7ceeea0d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:31:33.328388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1225/2430] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:31:33 2022] DELETE /identity/v3/projects/023c30e5231b467a8a95f4950d801ab1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:31:42.807381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=42,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:43.306653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:31:48.214449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309a3e-9825-4ad8-86bd-939748606282 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.215044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309a3e-9825-4ad8-86bd-939748606282 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.215150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309a3e-9825-4ad8-86bd-939748606282 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.216802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1206/2431] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:31:48.223324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f666-71ea-40ed-888b-00813bb45f56 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.223846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f666-71ea-40ed-888b-00813bb45f56 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.223948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f666-71ea-40ed-888b-00813bb45f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.245531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-bc46f666-71ea-40ed-888b-00813bb45f56 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:48.246891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bc46f666-71ea-40ed-888b-00813bb45f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:48.330877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1226/2432] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:31:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:48.348073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce309a3e-9825-4ad8-86bd-939748606282 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:48.349998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ce309a3e-9825-4ad8-86bd-939748606282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:48.413240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce309a3e-9825-4ad8-86bd-939748606282 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:48.416731 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393f21a-a79c-4705-b16d-7d7753f1f9b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:48.417340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f21a-a79c-4705-b16d-7d7753f1f9b6 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.417614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f21a-a79c-4705-b16d-7d7753f1f9b6 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.417885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f21a-a79c-4705-b16d-7d7753f1f9b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.428447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f21a-a79c-4705-b16d-7d7753f1f9b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:48.430320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f21a-a79c-4705-b16d-7d7753f1f9b6 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:48.441788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1207/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:48.511223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0773-4a0b-4d70-b6f3-bfa7ea5e4bf7 None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.511546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0773-4a0b-4d70-b6f3-bfa7ea5e4bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.511824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0773-4a0b-4d70-b6f3-bfa7ea5e4bf7 None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.513205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1227/2434] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:31:48.518409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f636-831a-4b5f-8dcb-64de245e0ea0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.518796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f636-831a-4b5f-8dcb-64de245e0ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.519074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f636-831a-4b5f-8dcb-64de245e0ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.546106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c2a5f636-831a-4b5f-8dcb-64de245e0ea0 None None] MFA Rules not processed for user `f354351c3e9d41d09ea2610b47cefa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:48.547413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c2a5f636-831a-4b5f-8dcb-64de245e0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:48.601723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1208/2435] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:31:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:48.613571 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c0773-4a0b-4d70-b6f3-bfa7ea5e4bf7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:48.615283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-585c0773-4a0b-4d70-b6f3-bfa7ea5e4bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:48.629475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c0773-4a0b-4d70-b6f3-bfa7ea5e4bf7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:48.634428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c50aa-e916-4e21-bc2c-f14ab5dbd743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:48.635045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c50aa-e916-4e21-bc2c-f14ab5dbd743 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.635318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c50aa-e916-4e21-bc2c-f14ab5dbd743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.635588 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c50aa-e916-4e21-bc2c-f14ab5dbd743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.644086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c50aa-e916-4e21-bc2c-f14ab5dbd743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:48.645565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c50aa-e916-4e21-bc2c-f14ab5dbd743 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:48.654228 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1228/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:48.742975 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39e66f-d8e7-407b-b21d-aa638b43ff33 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.743273 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39e66f-d8e7-407b-b21d-aa638b43ff33 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.743603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39e66f-d8e7-407b-b21d-aa638b43ff33 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.745004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1209/2437] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:31:48.751096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cbf40-5df9-4093-8c2d-bcc033c2a281 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.751395 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cbf40-5df9-4093-8c2d-bcc033c2a281 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.751679 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cbf40-5df9-4093-8c2d-bcc033c2a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.771766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-347cbf40-5df9-4093-8c2d-bcc033c2a281 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:48.773027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-347cbf40-5df9-4093-8c2d-bcc033c2a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:48.782442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1229/2438] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:31:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:48.793006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39e66f-d8e7-407b-b21d-aa638b43ff33 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:48.804104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39e66f-d8e7-407b-b21d-aa638b43ff33 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:48.808148 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:48.809030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:48.809503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:48.809847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:48.821206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:48.822693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:48.833905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1210/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:31:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:31:51.534027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd40b1f-0461-4b4f-82cb-d0f343c2905a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:51.534523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd40b1f-0461-4b4f-82cb-d0f343c2905a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:51.534630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd40b1f-0461-4b4f-82cb-d0f343c2905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:51.553687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ffd40b1f-0461-4b4f-82cb-d0f343c2905a None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:31:51.554890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ffd40b1f-0461-4b4f-82cb-d0f343c2905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:51.610899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1230/2440] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:31:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:31:51.622873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:31:51.624245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:31:51.693232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd55fae-60ab-49a7-8786-7c3e08121ce4 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:31:51.698143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:31:51.698806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:31:51.699091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:31:51.699359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:31:51.707756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:31:51.709437 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:31:51.717255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1211/2441] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:32:01.604160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=65 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:32:01.714188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=87 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:32:15.880860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90074b1-1d17-483f-b0ee-34907ea1ac7e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:15.881390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90074b1-1d17-483f-b0ee-34907ea1ac7e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:15.881390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90074b1-1d17-483f-b0ee-34907ea1ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:15.900850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e90074b1-1d17-483f-b0ee-34907ea1ac7e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:15.902043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e90074b1-1d17-483f-b0ee-34907ea1ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:15.963650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1231/2442] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:32:16.014915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:32:16.016455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:16.031224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66352-8fc0-410d-ace6-02dc39a9ac28 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:32:16.036504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:32:16.037086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:16.037361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:16.037629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:16.045876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:32:16.047482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:32:16.056716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1212/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:32:19.944361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb7af-2077-43cb-bd42-f1b2e650aeaf None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:19.944874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb7af-2077-43cb-bd42-f1b2e650aeaf None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:19.944874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb7af-2077-43cb-bd42-f1b2e650aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:19.964470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-f2beb7af-2077-43cb-bd42-f1b2e650aeaf None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:19.965665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f2beb7af-2077-43cb-bd42-f1b2e650aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:19.974090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1232/2444] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:32:19.994919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:32:19.996347 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:20.010711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c09ad4-735a-4c1c-a963-4bfa2fa012d3 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:32:20.016558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:32:20.017143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:20.017431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:20.017685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:20.025749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:32:20.027309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:32:20.037337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1213/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:32:21.503650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0d8e6-b955-49d5-8e7f-3c1a6887596e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:21.504072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0d8e6-b955-49d5-8e7f-3c1a6887596e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:21.504182 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0d8e6-b955-49d5-8e7f-3c1a6887596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:21.524861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-30d0d8e6-b955-49d5-8e7f-3c1a6887596e None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:21.526061 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-30d0d8e6-b955-49d5-8e7f-3c1a6887596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:21.533893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1233/2446] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 21 05:32:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:32:21.556380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:32:21.567830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a76d-0910-4847-8bc7-580f223b6aa5 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:32:21.573041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:32:21.573695 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:21.574013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:21.574292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:21.583040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:32:21.584759 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:32:21.593621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1214/2447] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:32:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:32:25.269449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a5cc-6b19-4e8a-b597-5b670f4529a6 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:25.269917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a5cc-6b19-4e8a-b597-5b670f4529a6 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:25.270040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a5cc-6b19-4e8a-b597-5b670f4529a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:25.289113 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-f881a5cc-6b19-4e8a-b597-5b670f4529a6 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:25.290320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f881a5cc-6b19-4e8a-b597-5b670f4529a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:25.298859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1234/2448] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:32:25.319590 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:32:25.331484 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d96d70-8111-4ce1-bde1-1cb3cbd534d2 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:32:25.336727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:32:25.337310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:25.337587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:25.337864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:25.346549 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:32:25.348114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:32:25.357801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1215/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:32:29.379082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80893a-3d8c-40cf-bbb0-2c662f1e24d3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:29.379562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80893a-3d8c-40cf-bbb0-2c662f1e24d3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:29.379671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80893a-3d8c-40cf-bbb0-2c662f1e24d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:29.398650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5b80893a-3d8c-40cf-bbb0-2c662f1e24d3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:29.399839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5b80893a-3d8c-40cf-bbb0-2c662f1e24d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:29.408049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1235/2450] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:32:29.431110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:32:29.442042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7652c-a11d-48f9-a49f-fa54a532b2ac service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:32:29.447394 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:32:29.447978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:29.448253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:29.448557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:29.456352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:32:29.457911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:32:29.467467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1216/2451] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:32:33.566901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ae2c-c725-4c43-8657-bd881db9e6df None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:33.567396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ae2c-c725-4c43-8657-bd881db9e6df None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:33.567501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ae2c-c725-4c43-8657-bd881db9e6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:33.586229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-acd3ae2c-c725-4c43-8657-bd881db9e6df None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:33.587417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-acd3ae2c-c725-4c43-8657-bd881db9e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:33.595435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1236/2452] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:32:33.618812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:32:33.630648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc1e69-c003-4624-9d80-e654a34cfe2d service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:32:33.636118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:32:33.636838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:33.637172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:33.637449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:33.645455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:32:33.647013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:32:33.656359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1217/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:32:37.783902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611d49-2f57-40ba-b39e-169ab738439c None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:37.784455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611d49-2f57-40ba-b39e-169ab738439c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:37.784564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611d49-2f57-40ba-b39e-169ab738439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:37.804863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-48611d49-2f57-40ba-b39e-169ab738439c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:37.806340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-48611d49-2f57-40ba-b39e-169ab738439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:37.814173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1237/2454] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:32:37.838582 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:32:37.850440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015eaedc-c450-4327-8b1d-c5ea175e7c0f service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:32:37.858872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:32:37.859842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:37.860817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:37.860817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:37.869926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:32:37.871652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:32:37.881963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1218/2455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:32:47.798975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=45 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:32:47.877472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=42 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:32:55.215635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed82937-2430-40b9-a4a3-6e3957fea3a1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:32:55.216164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed82937-2430-40b9-a4a3-6e3957fea3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:32:55.216259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed82937-2430-40b9-a4a3-6e3957fea3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:32:55.236245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-eed82937-2430-40b9-a4a3-6e3957fea3a1 None None] MFA Rules not processed for user `9f08e2e50d214193946f79da089e488c`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:32:55.237501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eed82937-2430-40b9-a4a3-6e3957fea3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:32:55.294984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1238/2456] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:32:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:05.287869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=25 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:33:08.993391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:08.994820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:09.008754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512edb4-1340-4364-af80-c06dce30c58f service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:09.013388 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647fefe-e7eb-4bd1-a0f9-1a4f6c484b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:09.014507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647fefe-e7eb-4bd1-a0f9-1a4f6c484b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:09.014958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647fefe-e7eb-4bd1-a0f9-1a4f6c484b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:09.015393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647fefe-e7eb-4bd1-a0f9-1a4f6c484b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:09.017372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7647fefe-e7eb-4bd1-a0f9-1a4f6c484b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:09.032328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647fefe-e7eb-4bd1-a0f9-1a4f6c484b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:09.033990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647fefe-e7eb-4bd1-a0f9-1a4f6c484b23 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:09.047790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1219/2457] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:11.537750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed82937-2430-40b9-a4a3-6e3957fea3a1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:11.547994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed82937-2430-40b9-a4a3-6e3957fea3a1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:11.551537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:11.552140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:11.552462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:11.552735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:11.554421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:11.568231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:11.569671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:11.580725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1239/2458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:12.125852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e277b-4bda-4a1e-857b-a0456b44a7f5 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:12.126379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e277b-4bda-4a1e-857b-a0456b44a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:12.126475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e277b-4bda-4a1e-857b-a0456b44a7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:12.146411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-895e277b-4bda-4a1e-857b-a0456b44a7f5 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:33:12.147539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-895e277b-4bda-4a1e-857b-a0456b44a7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:12.155822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1220/2459] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:12.178654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:12.190063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6ab0b-ebb7-45fc-991e-f28afaaef160 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:12.195380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:12.195971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:12.196248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:12.196549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:12.204334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:12.205893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:12.214931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1240/2460] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:16.385320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80c7a-4c4a-44b6-a73c-b0b134282f83 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:16.385842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80c7a-4c4a-44b6-a73c-b0b134282f83 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:16.385953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80c7a-4c4a-44b6-a73c-b0b134282f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:16.406483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-65b80c7a-4c4a-44b6-a73c-b0b134282f83 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:33:16.407685 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-65b80c7a-4c4a-44b6-a73c-b0b134282f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:16.415514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1221/2461] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:16.438984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:16.450004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670626b3-4f8a-49fc-8278-fdc0b46ce9e2 service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:16.455363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:16.455949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:16.456227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:16.456527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:16.464938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:16.466528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:16.476043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1241/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:20.505485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496de44-1f20-41f6-a962-5a5367cf2108 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:20.505972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496de44-1f20-41f6-a962-5a5367cf2108 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:20.506077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496de44-1f20-41f6-a962-5a5367cf2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:20.525299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2496de44-1f20-41f6-a962-5a5367cf2108 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:33:20.527097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2496de44-1f20-41f6-a962-5a5367cf2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:20.534920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1222/2463] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:20.557068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:20.568525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab58b6-1091-44ec-b9e1-87410b58d279 service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:20.573846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909608-0c71-46f6-af71-ca10102f9371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:20.574433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909608-0c71-46f6-af71-ca10102f9371 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:20.574709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909608-0c71-46f6-af71-ca10102f9371 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:20.574982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909608-0c71-46f6-af71-ca10102f9371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:20.582762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909608-0c71-46f6-af71-ca10102f9371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:20.584350 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909608-0c71-46f6-af71-ca10102f9371 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:20.593367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1242/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:25.641024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496de44-1f20-41f6-a962-5a5367cf2108 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:25.658553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496de44-1f20-41f6-a962-5a5367cf2108 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:25.665615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0cba5-7e67-4635-b145-a3268e22c9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:25.666592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cba5-7e67-4635-b145-a3268e22c9e9 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:25.667059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cba5-7e67-4635-b145-a3268e22c9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:25.667341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cba5-7e67-4635-b145-a3268e22c9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:25.669147 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-94d0cba5-7e67-4635-b145-a3268e22c9e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:25.729886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0cba5-7e67-4635-b145-a3268e22c9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:25.731601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0cba5-7e67-4635-b145-a3268e22c9e9 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:25.740990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1223/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:25.926385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1483894-5a0e-4af6-bc4a-c00d1a00f00a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:25.926899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1483894-5a0e-4af6-bc4a-c00d1a00f00a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:25.926899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1483894-5a0e-4af6-bc4a-c00d1a00f00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:25.947139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a1483894-5a0e-4af6-bc4a-c00d1a00f00a None None] MFA Rules not processed for user `686afeec87d34ad8a547d81f25de2428`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:33:25.948910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a1483894-5a0e-4af6-bc4a-c00d1a00f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:25.955691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1243/2466] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:26.755509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968a4c-93cf-4139-8485-6c24b19a39be None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:26.756001 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968a4c-93cf-4139-8485-6c24b19a39be None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:26.756096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968a4c-93cf-4139-8485-6c24b19a39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:26.776702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f9968a4c-93cf-4139-8485-6c24b19a39be None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:33:26.777903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f9968a4c-93cf-4139-8485-6c24b19a39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:26.786086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1224/2467] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:26.831586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1483894-5a0e-4af6-bc4a-c00d1a00f00a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:26.845083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1483894-5a0e-4af6-bc4a-c00d1a00f00a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:26.850693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d142d-c0c2-4bb8-80bc-5f208e7d0f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:26.851297 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d142d-c0c2-4bb8-80bc-5f208e7d0f1b service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:26.851573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d142d-c0c2-4bb8-80bc-5f208e7d0f1b service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:26.851842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d142d-c0c2-4bb8-80bc-5f208e7d0f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:26.860239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d142d-c0c2-4bb8-80bc-5f208e7d0f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:26.861842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d142d-c0c2-4bb8-80bc-5f208e7d0f1b service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:26.871580 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1244/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:30.188046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9968a4c-93cf-4139-8485-6c24b19a39be None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:30.200236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9968a4c-93cf-4139-8485-6c24b19a39be None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:30.205642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:30.206268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:30.206538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:30.206805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:30.208532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:30.267609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:30.269237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:30.278155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1225/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:35.081152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345292e-5b1b-4435-bfe7-2b08e9027ba7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:35.081606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345292e-5b1b-4435-bfe7-2b08e9027ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:35.081721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345292e-5b1b-4435-bfe7-2b08e9027ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:35.100900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-3345292e-5b1b-4435-bfe7-2b08e9027ba7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:33:35.102078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3345292e-5b1b-4435-bfe7-2b08e9027ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:35.110483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1245/2470] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 21 05:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:35.137433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:35.149168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f17b0-0911-450c-ace6-0ce40295b335 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:35.155546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554dd7b-d7af-4704-9173-219769a4d789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:35.156151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554dd7b-d7af-4704-9173-219769a4d789 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:35.156472 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554dd7b-d7af-4704-9173-219769a4d789 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:35.156749 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554dd7b-d7af-4704-9173-219769a4d789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:35.168436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554dd7b-d7af-4704-9173-219769a4d789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:35.170788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554dd7b-d7af-4704-9173-219769a4d789 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:35.181071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1226/2471] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:35.809429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345292e-5b1b-4435-bfe7-2b08e9027ba7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:35.814015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=37 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:33:35.820770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345292e-5b1b-4435-bfe7-2b08e9027ba7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:35.825076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:35.825682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:35.825962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:35.826234 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:35.827939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:35.838082 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:35.839525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:35.847570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1246/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:42.119653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:42.120781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:42.120899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:42.128541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=81 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:33:42.142307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] MFA Rules not processed for user `b6a423b67e4440628fe967429698a603`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:33:42.143520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:42.150432 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1227/2473] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:33:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:33:42.461298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:42.469777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ca14f-ffc6-42eb-b5b9-705ec4ade21d service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:42.473414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:42.474007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:42.474284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:42.474676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:42.476371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:42.485693 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:42.487220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:42.495505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1247/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:42.807177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:42.808630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:42.892729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217bc19-7b0d-46fd-92fe-151b16900887 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:42.897944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:42.898553 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:42.898835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:42.899108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:42.901405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:42.913149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:42.914732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:42.926415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1228/2475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:47.459908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:33:47.474074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845a9d-4f66-4803-926f-77a206abff61 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:33:47.480239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:33:47.480873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:33:47.481185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:33:47.481505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:33:47.483359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:33:47.495622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:33:47.497229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:33:47.521764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1248/2476] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:33:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:33:52.921866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=34 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:33:57.503951 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=17 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:34:08.381874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:08.383612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:08.399941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e05da-83db-4a51-8c25-1a6cf649e73d service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:08.405354 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:08.405980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:08.406290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:08.406568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] PATH_INFO: `/v3/users/9f08e2e50d214193946f79da089e488c` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:08.407737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f08e2e50d214193946f79da089e488c)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:08.409680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:08.454468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f08e2e50d214193946f79da089e488c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.461852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f08e2e50d214193946f79da089e488c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.462466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f08e2e50d214193946f79da089e488c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.475168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f08e2e50d214193946f79da089e488c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.482647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f08e2e50d214193946f79da089e488c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.488459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1229/2477] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:34:08 2022] DELETE /identity/v3/users/9f08e2e50d214193946f79da089e488c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:34:08.654209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:08.667125 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031be8-302b-41a0-8ce8-4e0ab62d9d06 service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:08.723735 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:08.724405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:08.724688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:08.724963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] PATH_INFO: `/v3/projects/9b5df8d8fe3046f59029afa7b8ffd004` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:08.726072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5df8d8fe3046f59029afa7b8ffd004)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:08.727976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:08.773043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5df8d8fe3046f59029afa7b8ffd004', 'request_id': 'req-d0d21ae8-a958-44fc-9f58-254dc74fccbb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.780856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5df8d8fe3046f59029afa7b8ffd004', 'request_id': 'req-d0d21ae8-a958-44fc-9f58-254dc74fccbb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.786599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5df8d8fe3046f59029afa7b8ffd004', 'request_id': 'req-d0d21ae8-a958-44fc-9f58-254dc74fccbb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.797458 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] The token cache is being invalidate because project 9b5df8d8fe3046f59029afa7b8ffd004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:34:08.797744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.798365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:08.799868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1249/2478] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:34:08 2022] DELETE /identity/v3/projects/9b5df8d8fe3046f59029afa7b8ffd004 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:34:13.839441 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:13.846257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:13.946048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343c196-345a-4e12-91d4-eb851bc0a034 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:14.024565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb200b04-0c3f-4730-8293-0a1205b21c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:14.025233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200b04-0c3f-4730-8293-0a1205b21c7b service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:14.025542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200b04-0c3f-4730-8293-0a1205b21c7b service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:14.025845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200b04-0c3f-4730-8293-0a1205b21c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:14.027795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cb200b04-0c3f-4730-8293-0a1205b21c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:14.047919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:34:14.050740 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb200b04-0c3f-4730-8293-0a1205b21c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:14.053500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb200b04-0c3f-4730-8293-0a1205b21c7b service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:14.067011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1230/2479] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:34:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:34:14.872957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:14.874771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:14.953764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d21ae8-a958-44fc-9f58-254dc74fccbb admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:14.958055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f068aa9-9951-431c-a877-7c48c7432871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:14.958664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f068aa9-9951-431c-a877-7c48c7432871 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:14.958942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f068aa9-9951-431c-a877-7c48c7432871 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:14.959215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f068aa9-9951-431c-a877-7c48c7432871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:14.963509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-8f068aa9-9951-431c-a877-7c48c7432871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:15.016517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:34:15.036220 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f068aa9-9951-431c-a877-7c48c7432871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:15.037692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f068aa9-9951-431c-a877-7c48c7432871 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:15.048244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1250/2480] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:34:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:34:22.259888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:22.260396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:22.260490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:22.281390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] MFA Rules not processed for user `f2951af9ee7c4c69847685e55d1b12b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:34:22.282665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:22.289769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1231/2481] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:34:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:34:24.976302 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:24.976804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:24.976905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:24.996649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:34:24.997840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:25.053106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1251/2482] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 21 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:34:25.103840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:25.105384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:25.184462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f51ad5-8469-487e-8aa2-ae89565b1353 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:25.189625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:25.190253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:25.190528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:25.190795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:25.200780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:25.202382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:25.212162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1232/2483] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:34:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:34:32.021573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:32.023168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:32.046753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673a76b-08c2-4faf-9ac0-7f0bcde425ff None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:32.055943 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:32.056841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:32.057272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:32.058984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:32.061200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:32.080640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:32.082535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:32.095882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1252/2484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:34:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:34:32.746792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:32.748298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:32.814036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82176717-ccd7-419e-b904-772c5bd95e36 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:32.818769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:32.819397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:32.819678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:32.819951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] PATH_INFO: `/v3/users/61869276fc7c4162932d04caf497b79d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:32.821135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61869276fc7c4162932d04caf497b79d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:32.823711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:32.869805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61869276fc7c4162932d04caf497b79d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:32.881633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61869276fc7c4162932d04caf497b79d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:32.882468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61869276fc7c4162932d04caf497b79d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:32.895046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61869276fc7c4162932d04caf497b79d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:32.902306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61869276fc7c4162932d04caf497b79d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:32.903707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:34:32.909846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1233/2485] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:34:32 2022] DELETE /identity/v3/users/61869276fc7c4162932d04caf497b79d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:34:33.080824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:33.099047 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601c35-5b44-4467-b322-88f0de2e0e68 service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:33.196313 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:33.196992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:33.197777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:33.198048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] PATH_INFO: `/v3/projects/741a4810b6814f4cac75f12936a7d3d7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:33.199190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=741a4810b6814f4cac75f12936a7d3d7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:33.201152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:33.254964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741a4810b6814f4cac75f12936a7d3d7', 'request_id': 'req-d69ca1fd-20f5-4082-a29b-ddeec66edf00'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.262897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741a4810b6814f4cac75f12936a7d3d7', 'request_id': 'req-d69ca1fd-20f5-4082-a29b-ddeec66edf00'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.268526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741a4810b6814f4cac75f12936a7d3d7', 'request_id': 'req-d69ca1fd-20f5-4082-a29b-ddeec66edf00'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.279427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] The token cache is being invalidate because project 741a4810b6814f4cac75f12936a7d3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:34:33.279720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.280389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.281877 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1253/2486] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:34:33 2022] DELETE /identity/v3/projects/741a4810b6814f4cac75f12936a7d3d7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:34:33.285738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:33.287214 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:33.300177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb7392-fda8-4789-9213-e414f1f81790 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:33.355322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:33.355948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:33.356224 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:33.356525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] PATH_INFO: `/v3/users/243b1ed42ac442b798a79e2002016bae` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:33.357620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=243b1ed42ac442b798a79e2002016bae)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:33.359532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:33.406219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243b1ed42ac442b798a79e2002016bae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.412770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243b1ed42ac442b798a79e2002016bae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.413617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243b1ed42ac442b798a79e2002016bae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.426216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243b1ed42ac442b798a79e2002016bae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.433762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243b1ed42ac442b798a79e2002016bae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.439622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1234/2487] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:34:33 2022] DELETE /identity/v3/users/243b1ed42ac442b798a79e2002016bae => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:34:33.618955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:33.620472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:33.633827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ca1fd-20f5-4082-a29b-ddeec66edf00 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:33.637549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:34:33.695505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:33.696134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:33.696468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:33.696746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] PATH_INFO: `/v3/projects/79fce63f3a9e4e64bfcb13d771ce96a1` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:33.697856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=79fce63f3a9e4e64bfcb13d771ce96a1)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:33.699774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:33.747083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79fce63f3a9e4e64bfcb13d771ce96a1', 'request_id': 'req-59408951-ec78-435a-a067-fc353dfb66ae'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.755067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79fce63f3a9e4e64bfcb13d771ce96a1', 'request_id': 'req-59408951-ec78-435a-a067-fc353dfb66ae'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.760614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79fce63f3a9e4e64bfcb13d771ce96a1', 'request_id': 'req-59408951-ec78-435a-a067-fc353dfb66ae'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.771429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] The token cache is being invalidate because project 79fce63f3a9e4e64bfcb13d771ce96a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:34:33.771720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.772386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:34:33.773893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1254/2488] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:34:33 2022] DELETE /identity/v3/projects/79fce63f3a9e4e64bfcb13d771ce96a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:34:43.436151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:34:43.768459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:34:58.404930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:34:58.406344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:58.466106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48340d-9b76-495d-973c-b8858a626f01 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:34:58.515689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:34:58.516343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:34:58.516631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:34:58.516906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:34:58.518765 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:34:58.586023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:34:58.587451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:34:58.596972 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1235/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:01.637263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:01.640360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:01.693946 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:01.696125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:01.717750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f44ed-0585-4752-8202-c645690453b0 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:01.722999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:01.723630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:01.724260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:01.724668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] PATH_INFO: `/v3/users/686afeec87d34ad8a547d81f25de2428` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:01.725717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] RBAC: Authorizing `identity:delete_user(user_id=686afeec87d34ad8a547d81f25de2428)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:01.727722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:01.732013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59408951-ec78-435a-a067-fc353dfb66ae admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:01.738943 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:01.739570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:01.739868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:01.740232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:01.742843 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:01.757834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:01.761701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:01.774657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1255/2490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:01.784243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686afeec87d34ad8a547d81f25de2428'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:01.795026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686afeec87d34ad8a547d81f25de2428'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:01.795646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686afeec87d34ad8a547d81f25de2428'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:01.805246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:35:01.816202 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686afeec87d34ad8a547d81f25de2428'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:01.824408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-83c75c74-32bd-4999-865a-a973cd42530f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686afeec87d34ad8a547d81f25de2428'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:01.833106 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1236/2491] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:35:01 2022] DELETE /identity/v3/users/686afeec87d34ad8a547d81f25de2428 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:35:02.005215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.016414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae086fe-e3d8-4285-8bf2-8656c1941dfa service placement] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.080390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.081018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.081303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.081578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] PATH_INFO: `/v3/projects/79a028c9ccfb438884df5457ebfebae7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.082701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a028c9ccfb438884df5457ebfebae7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.084649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.130883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a028c9ccfb438884df5457ebfebae7', 'request_id': 'req-331ad8f6-ef26-4cb1-bada-800fb6abc50d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:02.137892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a028c9ccfb438884df5457ebfebae7', 'request_id': 'req-331ad8f6-ef26-4cb1-bada-800fb6abc50d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:02.143270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a028c9ccfb438884df5457ebfebae7', 'request_id': 'req-331ad8f6-ef26-4cb1-bada-800fb6abc50d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:02.153947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] The token cache is being invalidate because project 79a028c9ccfb438884df5457ebfebae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:35:02.154236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:02.154881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-331ad8f6-ef26-4cb1-bada-800fb6abc50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:35:02.156361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1256/2492] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:35:02 2022] DELETE /identity/v3/projects/79a028c9ccfb438884df5457ebfebae7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:35:02.161399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37912-05fc-4223-9ab8-66c40ebe28ec None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.161688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37912-05fc-4223-9ab8-66c40ebe28ec None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.161964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37912-05fc-4223-9ab8-66c40ebe28ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.182051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-79c37912-05fc-4223-9ab8-66c40ebe28ec None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:02.183236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-79c37912-05fc-4223-9ab8-66c40ebe28ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:02.243206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1237/2493] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:02.251443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8e77-052c-43fa-93c8-a53b41e3a268 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.251730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8e77-052c-43fa-93c8-a53b41e3a268 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.252028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8e77-052c-43fa-93c8-a53b41e3a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.271601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-37bb8e77-052c-43fa-93c8-a53b41e3a268 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:02.272839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-37bb8e77-052c-43fa-93c8-a53b41e3a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:02.281159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1257/2494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:02.285489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37912-05fc-4223-9ab8-66c40ebe28ec None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.295720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37912-05fc-4223-9ab8-66c40ebe28ec None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.300248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.300874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.301156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.301434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.302102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:35:02.302409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.304078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.315591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1238/2495] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:35:02.319852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8e77-052c-43fa-93c8-a53b41e3a268 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.328938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8e77-052c-43fa-93c8-a53b41e3a268 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.333659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.334245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.334524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.334792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.335410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.337852 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.349190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:35:02.366714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1258/2496] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:35:02 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:35:02.370869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.381197 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aaee5-a3f7-4f01-907a-5e4d364eebaa admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.436392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.436996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.437280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.437554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.438180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.440089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.461397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1239/2497] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:35:02 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:35:02.465547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.475842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8e663-947a-41f3-8461-7f328aaade1e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.481134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.481725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.482002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.482273 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.482909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.484526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.494199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1259/2498] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:35:02.497842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.507559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987cf97-1382-4129-8d10-1e19bc08e722 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.512022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd3df9-4048-4fff-984e-089cdc103e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.512636 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd3df9-4048-4fff-984e-089cdc103e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.512913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd3df9-4048-4fff-984e-089cdc103e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.513184 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd3df9-4048-4fff-984e-089cdc103e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.513812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd3df9-4048-4fff-984e-089cdc103e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.515390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd3df9-4048-4fff-984e-089cdc103e13 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.526957 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1240/2499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:35:02.530768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.541033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c721c00-b6ae-4675-83f0-124a1db06ac7 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.545549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.546180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.546459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.546728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] PATH_INFO: `/v3/projects/a1269da257f44bbc834c5f610748f629/users/08babdf38b1f43568be6d4b82f983805/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.561462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1269da257f44bbc834c5f610748f629, user_id=08babdf38b1f43568be6d4b82f983805, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.564109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.576697 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1260/2500] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:35:02 2022] PUT /identity/v3/projects/a1269da257f44bbc834c5f610748f629/users/08babdf38b1f43568be6d4b82f983805/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:35:02.581693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c9d4-4dac-4844-a8c9-0b7890555d52 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.581979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c9d4-4dac-4844-a8c9-0b7890555d52 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.582254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c9d4-4dac-4844-a8c9-0b7890555d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.601146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2092c9d4-4dac-4844-a8c9-0b7890555d52 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:02.602985 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2092c9d4-4dac-4844-a8c9-0b7890555d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:02.641662 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:35:02.662438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1241/2501] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:02.672127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:02.673830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:02.730062 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20554c2a-7225-44d3-9a44-dbbd4b4cb93d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:02.733772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:02.734375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:02.734660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:02.734938 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:02.743858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:02.745367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:02.754866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1261/2502] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:06.571963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883ecf-d081-4f33-8b46-a770c86c0b5a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:06.572476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883ecf-d081-4f33-8b46-a770c86c0b5a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:06.572571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883ecf-d081-4f33-8b46-a770c86c0b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:06.600746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-48883ecf-d081-4f33-8b46-a770c86c0b5a None None] MFA Rules not processed for user `08babdf38b1f43568be6d4b82f983805`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:06.602583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48883ecf-d081-4f33-8b46-a770c86c0b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:06.669520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1242/2503] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:35:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:06.685224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:06.686953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:06.760646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5dcb7-34fb-4516-8a66-fee603e7b072 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:06.768216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ed9a9-afbc-4cbc-ab92-b328a50c2549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:06.768861 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ed9a9-afbc-4cbc-ab92-b328a50c2549 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:06.769145 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ed9a9-afbc-4cbc-ab92-b328a50c2549 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:06.769418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ed9a9-afbc-4cbc-ab92-b328a50c2549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:06.778104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ed9a9-afbc-4cbc-ab92-b328a50c2549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:06.779673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ed9a9-afbc-4cbc-ab92-b328a50c2549 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:06.788354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1262/2504] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:35:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:08.232408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:08.232915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:08.233012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:08.254228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] MFA Rules not processed for user `08babdf38b1f43568be6d4b82f983805`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:08.255540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:08.263054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1243/2505] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:35:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:16.784394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:35:18.247797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=42 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:35:34.413797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4373f6-9685-48e4-8cc7-daf3ce52e5e3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:34.414287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4373f6-9685-48e4-8cc7-daf3ce52e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:34.414387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4373f6-9685-48e4-8cc7-daf3ce52e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:34.434017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ca4373f6-9685-48e4-8cc7-daf3ce52e5e3 None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:34.435210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ca4373f6-9685-48e4-8cc7-daf3ce52e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:34.490467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1263/2506] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:34.537096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:34.538528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:34.606943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc1024-23c8-47da-a6db-3041fca79ae4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:34.611834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fb32a-927d-4c25-8095-ae2208e60b4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:34.612479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fb32a-927d-4c25-8095-ae2208e60b4d service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:34.612758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fb32a-927d-4c25-8095-ae2208e60b4d service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:34.613029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fb32a-927d-4c25-8095-ae2208e60b4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:34.621419 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fb32a-927d-4c25-8095-ae2208e60b4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:34.623013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fb32a-927d-4c25-8095-ae2208e60b4d service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:34.631180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1244/2507] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:35:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:35:44.483517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=25 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:35:44.627869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=32 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:35:49.113219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4373f6-9685-48e4-8cc7-daf3ce52e5e3 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:49.122498 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4373f6-9685-48e4-8cc7-daf3ce52e5e3 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:49.126298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc8b5b-2dce-4139-aa20-362706778dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:49.126917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8b5b-2dce-4139-aa20-362706778dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.127195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8b5b-2dce-4139-aa20-362706778dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.127465 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8b5b-2dce-4139-aa20-362706778dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.129316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-32fc8b5b-2dce-4139-aa20-362706778dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:49.138896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc8b5b-2dce-4139-aa20-362706778dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:49.140318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc8b5b-2dce-4139-aa20-362706778dc3 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:49.148897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1264/2508] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:35:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:49.268096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e8e48-f471-48af-84a6-e848513cbda4 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.268697 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e8e48-f471-48af-84a6-e848513cbda4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.268783 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e8e48-f471-48af-84a6-e848513cbda4 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.270464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1245/2509] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:35:49.277308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b460cb-80be-4587-a515-d79d8b88da60 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.277605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b460cb-80be-4587-a515-d79d8b88da60 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.277887 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b460cb-80be-4587-a515-d79d8b88da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.298939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-18b460cb-80be-4587-a515-d79d8b88da60 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:49.300142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-18b460cb-80be-4587-a515-d79d8b88da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:49.309521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1265/2510] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:35:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:49.321683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e8e48-f471-48af-84a6-e848513cbda4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:49.323341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e90e8e48-f471-48af-84a6-e848513cbda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:49.382864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e8e48-f471-48af-84a6-e848513cbda4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:49.386565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2856b-c0f1-4e1f-880e-77101a58dac6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:49.387172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2856b-c0f1-4e1f-880e-77101a58dac6 service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.387457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2856b-c0f1-4e1f-880e-77101a58dac6 service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.387729 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2856b-c0f1-4e1f-880e-77101a58dac6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.401108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2856b-c0f1-4e1f-880e-77101a58dac6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:49.401108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2856b-c0f1-4e1f-880e-77101a58dac6 service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:49.410744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1246/2511] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:49.478747 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f066-f9f7-407e-92a7-104b5823a24e None None] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.479033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f066-f9f7-407e-92a7-104b5823a24e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.479305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f066-f9f7-407e-92a7-104b5823a24e None None] PATH_INFO: `/` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.480653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1266/2512] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:35:49.485285 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c5253-2e51-43ed-84ae-791b0e37d0a3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.485621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c5253-2e51-43ed-84ae-791b0e37d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.485922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c5253-2e51-43ed-84ae-791b0e37d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.506317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bc5c5253-2e51-43ed-84ae-791b0e37d0a3 None None] MFA Rules not processed for user `f354351c3e9d41d09ea2610b47cefa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:49.507800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bc5c5253-2e51-43ed-84ae-791b0e37d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:49.514305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1247/2513] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:35:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:35:49.526403 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f066-f9f7-407e-92a7-104b5823a24e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:49.528056 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-97b7f066-f9f7-407e-92a7-104b5823a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:49.541477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f066-f9f7-407e-92a7-104b5823a24e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:49.544991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f94e9e-84b6-44ea-894e-808204b53115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:49.545575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f94e9e-84b6-44ea-894e-808204b53115 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.545856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f94e9e-84b6-44ea-894e-808204b53115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.546133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f94e9e-84b6-44ea-894e-808204b53115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.552848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f94e9e-84b6-44ea-894e-808204b53115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:49.554255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f94e9e-84b6-44ea-894e-808204b53115 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:49.561698 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1267/2514] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:35:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:49.642368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d947d7-443c-4889-9197-90ad87933078 None None] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.642655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d947d7-443c-4889-9197-90ad87933078 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.642931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d947d7-443c-4889-9197-90ad87933078 None None] PATH_INFO: `/` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.644340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1248/2515] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 21 05:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 05:35:49.650034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0b7f9-b81c-480e-baab-ff737d5839d5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.650317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0b7f9-b81c-480e-baab-ff737d5839d5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.650594 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0b7f9-b81c-480e-baab-ff737d5839d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.670741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1ab0b7f9-b81c-480e-baab-ff737d5839d5 None None] MFA Rules not processed for user `c83d5e7a41404bacb2b4d18daf040aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:49.672083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1ab0b7f9-b81c-480e-baab-ff737d5839d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:49.681775 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1268/2516] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 21 05:35:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:49.692041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d947d7-443c-4889-9197-90ad87933078 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:49.702728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d947d7-443c-4889-9197-90ad87933078 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:49.706426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:49.707014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:49.707290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:49.707559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:49.717801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:49.719558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:49.730505 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1249/2517] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:35:51.533269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce396-c6a9-45fc-85c4-6bd83e70ed6d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:51.533765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce396-c6a9-45fc-85c4-6bd83e70ed6d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:51.533858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce396-c6a9-45fc-85c4-6bd83e70ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:51.553080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0fdce396-c6a9-45fc-85c4-6bd83e70ed6d None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:35:51.554247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0fdce396-c6a9-45fc-85c4-6bd83e70ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:35:51.561351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1269/2518] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 21 05:35:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:35:51.573825 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:35:51.585376 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17d5e9-5fb2-46f5-9766-77976163e96a service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:35:51.590360 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:35:51.590954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:35:51.591233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:35:51.591507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:35:51.599961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:35:51.601581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:35:51.609709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1250/2519] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:35:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:36:01.547740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=21 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:01.606828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=41 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:12.628600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:12.629083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:12.629192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:12.668908 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] MFA Rules not processed for user `8c4901865c4748b7855435c801e37ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:12.670152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:12.702446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1270/2520] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 21 05:36:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:12.715453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:12.755976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d30e-b604-4e32-bfed-c78067364f8c service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:12.761014 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc038af597c45648f6603d2ef6d685c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:12.761601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:12.761879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:12.762180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:12.769951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:12.771518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:12.779644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1251/2521] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 21 05:36:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 05:36:14.450164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:14.451556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:14.541504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff3295-954b-4551-a3b2-da7d3aba840f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:14.549359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:14.549983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:14.550269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:14.550543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:14.552298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:14.566926 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:14.568553 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:14.579793 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1271/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:36:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:36:22.776563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=20 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:24.574932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=64 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:27.905588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:27.923984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a23577-2986-4e36-9914-8425cb35b220 service swift] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:27.927750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:27.928371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:27.928650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:27.928921 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:27.931235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:27.965995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:27.967417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:27.990123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1252/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:36:31.041630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.043417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:31.062900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f79d-bc82-479a-b69d-0a0cb315e913 service placement] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.067677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.068341 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.068627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.068905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] PATH_INFO: `/v3/users/f2951af9ee7c4c69847685e55d1b12b6` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.070039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2951af9ee7c4c69847685e55d1b12b6)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.071993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.120867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2951af9ee7c4c69847685e55d1b12b6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.130223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2951af9ee7c4c69847685e55d1b12b6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.131239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2951af9ee7c4c69847685e55d1b12b6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.140828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2951af9ee7c4c69847685e55d1b12b6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.153040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-4441e386-536c-440d-927c-8f43873af752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2951af9ee7c4c69847685e55d1b12b6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.159175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1272/2524] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:36:31 2022] DELETE /identity/v3/users/f2951af9ee7c4c69847685e55d1b12b6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:31.336029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.348232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ef3e1-4a26-412d-93e1-ce63a40b63b5 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.410666 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.411310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.411593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.411968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] PATH_INFO: `/v3/projects/ca8b8c8e8ffc4111b7bbeda7df43e1b4` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.413027 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8b8c8e8ffc4111b7bbeda7df43e1b4)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.415482 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.464836 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8b8c8e8ffc4111b7bbeda7df43e1b4', 'request_id': 'req-5777f56d-baef-41d1-a6a6-6b740aa22d02'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.470365 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8b8c8e8ffc4111b7bbeda7df43e1b4', 'request_id': 'req-5777f56d-baef-41d1-a6a6-6b740aa22d02'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.477235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8b8c8e8ffc4111b7bbeda7df43e1b4', 'request_id': 'req-5777f56d-baef-41d1-a6a6-6b740aa22d02'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.489216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] The token cache is being invalidate because project ca8b8c8e8ffc4111b7bbeda7df43e1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:36:31.489552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.490162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-5777f56d-baef-41d1-a6a6-6b740aa22d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:31.491627 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1253/2525] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:36:31 2022] DELETE /identity/v3/projects/ca8b8c8e8ffc4111b7bbeda7df43e1b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:31.496916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c39c-90e9-48d4-9dce-21d5cd8397b3 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.497216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c39c-90e9-48d4-9dce-21d5cd8397b3 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.497518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c39c-90e9-48d4-9dce-21d5cd8397b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.554648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7f68c39c-90e9-48d4-9dce-21d5cd8397b3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:31.555865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7f68c39c-90e9-48d4-9dce-21d5cd8397b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:31.614161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1273/2526] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:31.621993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742957c-3c66-4750-8ea2-b228ecf0cc9d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.622292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742957c-3c66-4750-8ea2-b228ecf0cc9d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.622566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742957c-3c66-4750-8ea2-b228ecf0cc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.642256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a742957c-3c66-4750-8ea2-b228ecf0cc9d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:31.643516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a742957c-3c66-4750-8ea2-b228ecf0cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:31.651971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1254/2527] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:36:31.656088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68c39c-90e9-48d4-9dce-21d5cd8397b3 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.666023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68c39c-90e9-48d4-9dce-21d5cd8397b3 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.671344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.672180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.672494 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.673011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.673904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:36:31.674210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.676076 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.687334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1274/2528] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:36:31.691603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742957c-3c66-4750-8ea2-b228ecf0cc9d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.700801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742957c-3c66-4750-8ea2-b228ecf0cc9d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.705420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.706011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.706296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.706572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.707206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.709152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.738745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1255/2529] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:36:31 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:36:31.743808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.754333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6dce-9f87-45ef-98d0-e188ebf7368e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.780581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:31.812245 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.812902 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.813163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.813440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.814104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.816031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.837840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1275/2530] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:36:31 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:36:31.842247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.852728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef551d55-e859-4441-80ab-ff8445cb124e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.857361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.857961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.858242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.858513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.859149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.860821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.866108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:31.871499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1256/2531] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:36:31.877083 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.889780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073e69-11ca-4818-afbe-1899d6fc3097 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.894746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c66ba2-fcf4-4604-bac7-6055bc253d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.895353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c66ba2-fcf4-4604-bac7-6055bc253d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.895636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c66ba2-fcf4-4604-bac7-6055bc253d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.895910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c66ba2-fcf4-4604-bac7-6055bc253d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.896610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c66ba2-fcf4-4604-bac7-6055bc253d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.898901 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c66ba2-fcf4-4604-bac7-6055bc253d71 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.909340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1276/2532] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:36:31.913464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:31.923307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e89272-477d-495e-9a52-eca1879b6e84 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:31.927898 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:31.928576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.928860 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.929135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] PATH_INFO: `/v3/projects/35531ea8b1c14c5580235bb8765069d3/users/f46684933ba943ad8b7a258bb135daf9/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:31.943292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35531ea8b1c14c5580235bb8765069d3, user_id=f46684933ba943ad8b7a258bb135daf9, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:31.946521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:31.959635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1257/2533] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:36:31 2022] PUT /identity/v3/projects/35531ea8b1c14c5580235bb8765069d3/users/f46684933ba943ad8b7a258bb135daf9/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:31.971520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30db4f-f2fb-4d96-bd54-c78d82dbccb9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:31.971816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30db4f-f2fb-4d96-bd54-c78d82dbccb9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:31.972094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30db4f-f2fb-4d96-bd54-c78d82dbccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:32.002183 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-4a30db4f-f2fb-4d96-bd54-c78d82dbccb9 None None] MFA Rules not processed for user `f46684933ba943ad8b7a258bb135daf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:32.003374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-4a30db4f-f2fb-4d96-bd54-c78d82dbccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:32.073007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1277/2534] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:36:32.083607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:32.085329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:32.162632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adc64-dfc0-4277-a72f-4b71b9469147 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:32.168327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9cdc-7bc1-49b6-96a9-ff487736e740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:32.169176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9cdc-7bc1-49b6-96a9-ff487736e740 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:32.169533 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9cdc-7bc1-49b6-96a9-ff487736e740 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:32.169816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9cdc-7bc1-49b6-96a9-ff487736e740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:32.178096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c9cdc-7bc1-49b6-96a9-ff487736e740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:32.180058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c9cdc-7bc1-49b6-96a9-ff487736e740 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:32.188669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1258/2535] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:36:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:36:40.816869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30db4f-f2fb-4d96-bd54-c78d82dbccb9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:40.885348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30db4f-f2fb-4d96-bd54-c78d82dbccb9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:40.889865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:40.890489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:40.890770 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:40.891044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] PATH_INFO: `/v3/users/f46684933ba943ad8b7a258bb135daf9` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:40.892158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46684933ba943ad8b7a258bb135daf9)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:40.894109 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:40.933973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:40.941237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46684933ba943ad8b7a258bb135daf9'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:40.948910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46684933ba943ad8b7a258bb135daf9'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:40.949618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46684933ba943ad8b7a258bb135daf9'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:40.956621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46684933ba943ad8b7a258bb135daf9'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:40.968940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46684933ba943ad8b7a258bb135daf9'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:40.974785 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1278/2536] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:36:40 2022] DELETE /identity/v3/users/f46684933ba943ad8b7a258bb135daf9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:40.979330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:40.979735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:40.979909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:40.999499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:41.000648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:41.058345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1259/2537] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:41.068175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.069699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:41.139105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b75b-6c50-4bfe-9fed-d079c90abf1f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.142789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10db3-aaa6-447e-8bb2-d9220ae77367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.143390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10db3-aaa6-447e-8bb2-d9220ae77367 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.143672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10db3-aaa6-447e-8bb2-d9220ae77367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.143947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10db3-aaa6-447e-8bb2-d9220ae77367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.152878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10db3-aaa6-447e-8bb2-d9220ae77367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.154298 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10db3-aaa6-447e-8bb2-d9220ae77367 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.163488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1279/2538] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:36:41.432385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.434134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:41.447565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70810e-8700-4a26-bd0d-efd792df1541 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.463126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.463762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.464050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.464366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] PATH_INFO: `/v3/projects/35531ea8b1c14c5580235bb8765069d3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.465504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] RBAC: Authorizing `identity:delete_project(project_id=35531ea8b1c14c5580235bb8765069d3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.467508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.514904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35531ea8b1c14c5580235bb8765069d3', 'request_id': 'req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:41.518616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:41.521242 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35531ea8b1c14c5580235bb8765069d3', 'request_id': 'req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:41.529706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35531ea8b1c14c5580235bb8765069d3', 'request_id': 'req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:41.542528 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] The token cache is being invalidate because project 35531ea8b1c14c5580235bb8765069d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:36:41.542873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:41.543508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cf68cb28-0e71-4fa3-bf66-cb4a363cacea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:41.545011 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1260/2539] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:36:41 2022] DELETE /identity/v3/projects/35531ea8b1c14c5580235bb8765069d3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:41.550072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5a85f-94b8-43c3-bd79-a659597bc7cb None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.550361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5a85f-94b8-43c3-bd79-a659597bc7cb None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.550634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5a85f-94b8-43c3-bd79-a659597bc7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.570746 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0ca5a85f-94b8-43c3-bd79-a659597bc7cb None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:41.571998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0ca5a85f-94b8-43c3-bd79-a659597bc7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:41.629540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1280/2540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:41.637357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2569-3621-4728-bb9a-da08d10c4491 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.637641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2569-3621-4728-bb9a-da08d10c4491 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.637913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2569-3621-4728-bb9a-da08d10c4491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.656835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-76bb2569-3621-4728-bb9a-da08d10c4491 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:41.658010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-76bb2569-3621-4728-bb9a-da08d10c4491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:41.666144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1261/2541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:41.670122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5a85f-94b8-43c3-bd79-a659597bc7cb None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.681811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5a85f-94b8-43c3-bd79-a659597bc7cb None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.686348 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.686947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.687222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.687493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.688159 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:36:41.688493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.690067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.701067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1281/2542] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:36:41.705191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2569-3621-4728-bb9a-da08d10c4491 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.714329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2569-3621-4728-bb9a-da08d10c4491 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.718935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.719524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.719806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.720087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.720787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.722722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.751044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1262/2543] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:36:41 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:36:41.755127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.765290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b5e84-0cc2-4889-af43-7093bbe6a45d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.811088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:41.839576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.840195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.840504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.845157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.845157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.845157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.872229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1282/2544] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:36:41 2022] POST /identity/v3/users => generated 279 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:36:41.877604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.887943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4f08-9cea-47b2-909c-9fe81e617b90 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.892977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.893675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.893960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.894228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.894893 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.896509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.907902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1263/2545] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:36:41.912452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.923446 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052621c7-97ff-46c8-b9d7-3d2da43fab4e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.928148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141344b4-7037-4fb7-88f8-4b905f21a751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.928787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141344b4-7037-4fb7-88f8-4b905f21a751 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.929075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141344b4-7037-4fb7-88f8-4b905f21a751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.929351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141344b4-7037-4fb7-88f8-4b905f21a751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.930004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141344b4-7037-4fb7-88f8-4b905f21a751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.931623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141344b4-7037-4fb7-88f8-4b905f21a751 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.941903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1283/2546] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:36:41.947457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:41.957799 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006666-0603-41a4-8f02-7a0dda73e58d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:41.962976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:41.963620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:41.963895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:41.964167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] PATH_INFO: `/v3/projects/05868f8071854f7aba01d6bd7813c8eb/users/658e904135b74391aa7a01bee810c944/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:41.981261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05868f8071854f7aba01d6bd7813c8eb, user_id=658e904135b74391aa7a01bee810c944, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:41.983976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:41.998522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1264/2547] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:36:41 2022] PUT /identity/v3/projects/05868f8071854f7aba01d6bd7813c8eb/users/658e904135b74391aa7a01bee810c944/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:42.009399 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd024-37a9-4572-834f-eac748c16f50 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.009692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd024-37a9-4572-834f-eac748c16f50 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.009979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd024-37a9-4572-834f-eac748c16f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.038146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-78ecd024-37a9-4572-834f-eac748c16f50 None None] MFA Rules not processed for user `658e904135b74391aa7a01bee810c944`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:42.039271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-78ecd024-37a9-4572-834f-eac748c16f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:42.107431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1284/2548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:42.112186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.179952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15387918-9a3b-46cd-8cae-2d053f40df7c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.184580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.185183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.185459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.185728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.186344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.188680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.217709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1265/2549] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:36:42 2022] POST /identity/v3/projects => generated 355 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:36:42.221944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecd024-37a9-4572-834f-eac748c16f50 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.236467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecd024-37a9-4572-834f-eac748c16f50 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.299779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.300345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.300630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.300932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.301577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.303903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.326052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1285/2550] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:36:42 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:36:42.330041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.340843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f57595-34f8-4475-a3fb-576818e66176 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.345389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.345976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.346253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.346521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.347150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.348774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.359554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1266/2551] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:36:42.366613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.376642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b23e-df5c-4b5b-8df7-f79af19c4dad admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.381323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.382007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.382293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.382568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] PATH_INFO: `/v3/projects/0fbb9eea6968447e81a20f652be339a8/users/d1c64b62b8bc455fa7f89ee42fbf0651/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.402740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbb9eea6968447e81a20f652be339a8, user_id=d1c64b62b8bc455fa7f89ee42fbf0651, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.405595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.423169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1286/2552] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:36:42 2022] PUT /identity/v3/projects/0fbb9eea6968447e81a20f652be339a8/users/d1c64b62b8bc455fa7f89ee42fbf0651/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:42.427748 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.442317 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01312000-2ad7-4319-804c-c0e3a8038ebe admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.500246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:42.512054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1dc73-823c-43b0-95a1-e1e3a71623ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.512962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1dc73-823c-43b0-95a1-e1e3a71623ca admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.513244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1dc73-823c-43b0-95a1-e1e3a71623ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.513515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1dc73-823c-43b0-95a1-e1e3a71623ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.514144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1dc73-823c-43b0-95a1-e1e3a71623ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.515726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1dc73-823c-43b0-95a1-e1e3a71623ca admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.526857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1267/2553] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:36:42.531031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.541071 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154bfad-fab9-40f6-8136-963fad5bcdbd admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.545730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.546369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.546646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.546918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] PATH_INFO: `/v3/projects/0fbb9eea6968447e81a20f652be339a8/users/d1c64b62b8bc455fa7f89ee42fbf0651/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.549165 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbb9eea6968447e81a20f652be339a8, user_id=d1c64b62b8bc455fa7f89ee42fbf0651, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.551845 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.554955 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:42.567247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1287/2554] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:36:42 2022] PUT /identity/v3/projects/0fbb9eea6968447e81a20f652be339a8/users/d1c64b62b8bc455fa7f89ee42fbf0651/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:42.579772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6964e55-7b09-4d3a-b31d-e28a2bd79064 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.580244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6964e55-7b09-4d3a-b31d-e28a2bd79064 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.580552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6964e55-7b09-4d3a-b31d-e28a2bd79064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.608960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f6964e55-7b09-4d3a-b31d-e28a2bd79064 None None] MFA Rules not processed for user `d1c64b62b8bc455fa7f89ee42fbf0651`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:42.610208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f6964e55-7b09-4d3a-b31d-e28a2bd79064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:42.677664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1268/2555] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:42.689336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.691060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:42.746670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e0d33-2616-41e7-ac60-f2044ee493e2 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.750728 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2cdaa-0369-406c-a688-c4db4bb28b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.751320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2cdaa-0369-406c-a688-c4db4bb28b50 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.751599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2cdaa-0369-406c-a688-c4db4bb28b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.751874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2cdaa-0369-406c-a688-c4db4bb28b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.761596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2cdaa-0369-406c-a688-c4db4bb28b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.763032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2cdaa-0369-406c-a688-c4db4bb28b50 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.781706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1288/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:36:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:36:42.856049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6964e55-7b09-4d3a-b31d-e28a2bd79064 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:42.865796 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6964e55-7b09-4d3a-b31d-e28a2bd79064 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:42.870212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:42.870850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:42.871246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:42.871520 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:42.926758 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:42.928188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:42.937440 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1269/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:36:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:36:45.698461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5edf-6e5a-4990-89b5-b346ab7fab50 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:45.698964 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5edf-6e5a-4990-89b5-b346ab7fab50 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:45.699079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5edf-6e5a-4990-89b5-b346ab7fab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:45.717988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1d4d5edf-6e5a-4990-89b5-b346ab7fab50 None None] MFA Rules not processed for user `08babdf38b1f43568be6d4b82f983805`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:45.719187 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1d4d5edf-6e5a-4990-89b5-b346ab7fab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:45.772345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1289/2558] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:52.933448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=67 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:55.765642 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=53 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:57.944993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:58.022897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496df8c-3584-4b5f-86ab-f377b8fe3811 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:58.028345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:58.028982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:58.029459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:58.029741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] PATH_INFO: `/v3/users/658e904135b74391aa7a01bee810c944` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:58.030865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658e904135b74391aa7a01bee810c944)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:58.032847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:58.080908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658e904135b74391aa7a01bee810c944'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.092925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658e904135b74391aa7a01bee810c944'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.093600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658e904135b74391aa7a01bee810c944'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.106915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658e904135b74391aa7a01bee810c944'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.114616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658e904135b74391aa7a01bee810c944'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.120968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1270/2559] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:36:57 2022] DELETE /identity/v3/users/658e904135b74391aa7a01bee810c944 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:58.125424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:58.125913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:58.126008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:58.145638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:58.146855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:58.206044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1290/2560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:58.216738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:58.218911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:58.276479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dba43f-1639-45bf-8a40-48c5bbfaf803 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:58.280173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:58.280812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:58.281097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:58.281422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:58.290398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:58.291839 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:58.302306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1271/2561] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:36:58.620379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:58.621846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:58.634457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9e29-84e4-4d4a-b34f-267e8628015b None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:58.640454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:58.641256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:58.641637 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:58.642011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] PATH_INFO: `/v3/projects/05868f8071854f7aba01d6bd7813c8eb` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:58.643276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05868f8071854f7aba01d6bd7813c8eb)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:58.648320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:58.704321 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05868f8071854f7aba01d6bd7813c8eb', 'request_id': 'req-60b018e1-bfe3-440f-ba27-2c859cd0f325'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.713476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05868f8071854f7aba01d6bd7813c8eb', 'request_id': 'req-60b018e1-bfe3-440f-ba27-2c859cd0f325'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.721054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05868f8071854f7aba01d6bd7813c8eb', 'request_id': 'req-60b018e1-bfe3-440f-ba27-2c859cd0f325'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.733989 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] The token cache is being invalidate because project 05868f8071854f7aba01d6bd7813c8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:36:58.734929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.735619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.738356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1291/2562] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:36:58 2022] DELETE /identity/v3/projects/05868f8071854f7aba01d6bd7813c8eb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:58.742475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:58.755219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3708-721e-4057-9c1a-27330590c0dc service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:58.775864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:58.819042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:58.819670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:58.819949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:58.820217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] PATH_INFO: `/v3/users/d1c64b62b8bc455fa7f89ee42fbf0651` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:58.821399 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c64b62b8bc455fa7f89ee42fbf0651)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:58.823346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:58.880375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c64b62b8bc455fa7f89ee42fbf0651'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.889872 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c64b62b8bc455fa7f89ee42fbf0651'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.890811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c64b62b8bc455fa7f89ee42fbf0651'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.909062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c64b62b8bc455fa7f89ee42fbf0651'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.917996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3554f5b9-2728-4a7a-98cd-c48ff1c53dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c64b62b8bc455fa7f89ee42fbf0651'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:58.924186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1272/2563] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:36:58 2022] DELETE /identity/v3/users/d1c64b62b8bc455fa7f89ee42fbf0651 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:59.208168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.210659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:59.226971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b018e1-bfe3-440f-ba27-2c859cd0f325 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:59.297557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:59.298206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.298518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.298802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] PATH_INFO: `/v3/projects/0fbb9eea6968447e81a20f652be339a8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.299978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fbb9eea6968447e81a20f652be339a8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:59.301985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:59.333842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:59.353116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fbb9eea6968447e81a20f652be339a8', 'request_id': 'req-3fa491dc-5a10-4f19-9488-b47f24963626'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:59.361202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fbb9eea6968447e81a20f652be339a8', 'request_id': 'req-3fa491dc-5a10-4f19-9488-b47f24963626'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:59.368624 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fbb9eea6968447e81a20f652be339a8', 'request_id': 'req-3fa491dc-5a10-4f19-9488-b47f24963626'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:59.384038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] The token cache is being invalidate because project 0fbb9eea6968447e81a20f652be339a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:36:59.384367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:59.385057 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3fa491dc-5a10-4f19-9488-b47f24963626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:36:59.386577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1292/2564] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:36:59 2022] DELETE /identity/v3/projects/0fbb9eea6968447e81a20f652be339a8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:59.391421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca817-083b-4335-8c9c-187dc2115331 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.391909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca817-083b-4335-8c9c-187dc2115331 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.392022 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca817-083b-4335-8c9c-187dc2115331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.414127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dd2ca817-083b-4335-8c9c-187dc2115331 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:59.416008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dd2ca817-083b-4335-8c9c-187dc2115331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:59.479051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1273/2565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:59.487044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706368c-f457-44ec-b8a7-20fd04dfecdf None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.487269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706368c-f457-44ec-b8a7-20fd04dfecdf None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.487551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706368c-f457-44ec-b8a7-20fd04dfecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.509028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c706368c-f457-44ec-b8a7-20fd04dfecdf None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:59.509028 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c706368c-f457-44ec-b8a7-20fd04dfecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:59.518791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1293/2566] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:59.522936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ca817-083b-4335-8c9c-187dc2115331 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.533447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ca817-083b-4335-8c9c-187dc2115331 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:59.537932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:59.538537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.538818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.539092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.539762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:36:59.540064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:59.541705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:59.553213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1274/2567] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:36:59.557469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706368c-f457-44ec-b8a7-20fd04dfecdf None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.566918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706368c-f457-44ec-b8a7-20fd04dfecdf None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:59.572218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:59.572883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.573190 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.573484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.574121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:59.576032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:59.604464 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1294/2568] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:36:59 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:36:59.608733 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.619460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dc8e2-1750-4535-9cec-ccf315d22434 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:59.646073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:36:59.679320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:59.679958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.680269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.680597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.681225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:59.683196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:59.706013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1275/2569] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:36:59 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:36:59.710213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.721066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef34de-44f3-410d-ac82-069c6861d3c4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:59.727893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:59.728985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.729451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.729918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.731050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:59.733667 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:59.744114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1295/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:36:59.748183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.758877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fcd90-b813-4eb2-a695-12cc7af18fca admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:59.763447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aac842-ba30-4f4a-8b8b-b27225c69ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:59.764042 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aac842-ba30-4f4a-8b8b-b27225c69ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.764352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aac842-ba30-4f4a-8b8b-b27225c69ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.764629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aac842-ba30-4f4a-8b8b-b27225c69ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.765268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aac842-ba30-4f4a-8b8b-b27225c69ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:59.766846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aac842-ba30-4f4a-8b8b-b27225c69ba9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:59.777873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1276/2571] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:36:59.782032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.791916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f021df9-d005-4bdc-a1ee-8a33f8b1c270 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:36:59.796658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:36:59.797308 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.797589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.797865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] PATH_INFO: `/v3/projects/b6f90bcd2fbf4620bfb26268b3236d26/users/720ab7e993bf4180a7eecc4e4e42c4c4/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.812798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f90bcd2fbf4620bfb26268b3236d26, user_id=720ab7e993bf4180a7eecc4e4e42c4c4, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:36:59.815445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:36:59.829253 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1296/2572] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:36:59 2022] PUT /identity/v3/projects/b6f90bcd2fbf4620bfb26268b3236d26/users/720ab7e993bf4180a7eecc4e4e42c4c4/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:36:59.841343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba776f-bb0a-4016-9e60-fa54ad0f2ab1 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:36:59.841640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba776f-bb0a-4016-9e60-fa54ad0f2ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:36:59.841914 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba776f-bb0a-4016-9e60-fa54ad0f2ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:36:59.869943 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c2ba776f-bb0a-4016-9e60-fa54ad0f2ab1 None None] MFA Rules not processed for user `720ab7e993bf4180a7eecc4e4e42c4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:36:59.871140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c2ba776f-bb0a-4016-9e60-fa54ad0f2ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:36:59.933444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1277/2573] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:36:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:36:59.938014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:36:59.998079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e80b5-8ad1-436a-b3cf-d9d4e09234d5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.002935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.003535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.003815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.004088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.004750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.006636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.032718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1297/2574] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:36:59 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:00.036494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba776f-bb0a-4016-9e60-fa54ad0f2ab1 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.047255 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba776f-bb0a-4016-9e60-fa54ad0f2ab1 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.103170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.103779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.104055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.104352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.104969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.106878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.128594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1278/2575] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:00 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:00.132535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.143344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106acc1-4d22-48cf-b075-60c444efa71f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.147944 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.148616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.148884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.149163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.149806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.151397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.161652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1298/2576] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:00.165895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.175840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec045f-91b6-4813-ae55-864609b5c52a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.180988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.181632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.181910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.182208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] PATH_INFO: `/v3/projects/7b46f46e6b844a348c5a7e3c4bfcc911/users/ab0418e38e994b70b32fb25d36a0f8c6/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.197318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b46f46e6b844a348c5a7e3c4bfcc911, user_id=ab0418e38e994b70b32fb25d36a0f8c6, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.199996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.212700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1279/2577] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:00 2022] PUT /identity/v3/projects/7b46f46e6b844a348c5a7e3c4bfcc911/users/ab0418e38e994b70b32fb25d36a0f8c6/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:00.216598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.226428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1fd0d-cd7f-4507-94b7-6f2f94c27e90 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.246719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:00.284709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4206746-280f-4a3a-8914-6b3a8cf0aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.285244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4206746-280f-4a3a-8914-6b3a8cf0aff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.285526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4206746-280f-4a3a-8914-6b3a8cf0aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.285803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4206746-280f-4a3a-8914-6b3a8cf0aff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.286440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4206746-280f-4a3a-8914-6b3a8cf0aff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.288026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4206746-280f-4a3a-8914-6b3a8cf0aff4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.298283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1299/2578] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:00.302445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.308379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:00.314722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe331d0-9e15-4959-9b53-a1d332b43a49 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.319576 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.320217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.320555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.321044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] PATH_INFO: `/v3/projects/7b46f46e6b844a348c5a7e3c4bfcc911/users/ab0418e38e994b70b32fb25d36a0f8c6/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.322918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b46f46e6b844a348c5a7e3c4bfcc911, user_id=ab0418e38e994b70b32fb25d36a0f8c6, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.325622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.335672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1280/2579] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:00 2022] PUT /identity/v3/projects/7b46f46e6b844a348c5a7e3c4bfcc911/users/ab0418e38e994b70b32fb25d36a0f8c6/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:00.345936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a411-cbdf-4fdd-b5dc-eb800e9770b7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.346232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a411-cbdf-4fdd-b5dc-eb800e9770b7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.346627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a411-cbdf-4fdd-b5dc-eb800e9770b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.375524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-88f0a411-cbdf-4fdd-b5dc-eb800e9770b7 None None] MFA Rules not processed for user `ab0418e38e994b70b32fb25d36a0f8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:00.376806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-88f0a411-cbdf-4fdd-b5dc-eb800e9770b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:00.441954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1300/2580] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:00.453225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.454952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:00.512243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d8d76-84bd-46ab-b79b-e55774b0b861 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.515801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f44c9d-1b65-43d1-8419-99fee25865f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.516446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44c9d-1b65-43d1-8419-99fee25865f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.516721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44c9d-1b65-43d1-8419-99fee25865f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.516989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44c9d-1b65-43d1-8419-99fee25865f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.525631 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f44c9d-1b65-43d1-8419-99fee25865f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.527060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f44c9d-1b65-43d1-8419-99fee25865f4 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.536182 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1281/2581] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:00.602759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a411-cbdf-4fdd-b5dc-eb800e9770b7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.663110 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a411-cbdf-4fdd-b5dc-eb800e9770b7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.668212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.668865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.669142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.669413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] PATH_INFO: `/v3/users/720ab7e993bf4180a7eecc4e4e42c4c4` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.670535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=720ab7e993bf4180a7eecc4e4e42c4c4)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.672472 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.715895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720ab7e993bf4180a7eecc4e4e42c4c4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:00.717493 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:00.723561 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720ab7e993bf4180a7eecc4e4e42c4c4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:00.724413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720ab7e993bf4180a7eecc4e4e42c4c4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:00.731879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720ab7e993bf4180a7eecc4e4e42c4c4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:00.743555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720ab7e993bf4180a7eecc4e4e42c4c4'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:00.749993 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1301/2582] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:00 2022] DELETE /identity/v3/users/720ab7e993bf4180a7eecc4e4e42c4c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:00.755583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.755874 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.756149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.775871 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:00.777288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:00.833951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1282/2583] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:00.844015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:00.845451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:00.902810 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aeaa-81aa-4058-8ecd-7845b941d48f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:00.906530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:00.907136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:00.907416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:00.907690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:00.917104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:00.918534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:00.927826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1302/2584] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:01.190770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:01.192754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:01.205721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ccca-1e6b-4f83-9779-afd04469f1d7 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:01.210318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:01.210932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:01.211273 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:01.212213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] PATH_INFO: `/v3/projects/b6f90bcd2fbf4620bfb26268b3236d26` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:01.213385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f90bcd2fbf4620bfb26268b3236d26)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:01.215306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:01.262398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f90bcd2fbf4620bfb26268b3236d26', 'request_id': 'req-d005b80e-81a9-46ae-80e7-d462ea6a96b2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.267804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f90bcd2fbf4620bfb26268b3236d26', 'request_id': 'req-d005b80e-81a9-46ae-80e7-d462ea6a96b2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.274599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f90bcd2fbf4620bfb26268b3236d26', 'request_id': 'req-d005b80e-81a9-46ae-80e7-d462ea6a96b2'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.286589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] The token cache is being invalidate because project b6f90bcd2fbf4620bfb26268b3236d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:01.286904 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.287524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.289037 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1283/2585] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:01 2022] DELETE /identity/v3/projects/b6f90bcd2fbf4620bfb26268b3236d26 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:01.293065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:01.302543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ccf60-082f-4626-9995-93a69054eb69 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:01.358410 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:01.359059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:01.359361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:01.359632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] PATH_INFO: `/v3/users/ab0418e38e994b70b32fb25d36a0f8c6` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:01.360764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0418e38e994b70b32fb25d36a0f8c6)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:01.362718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:01.414952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0418e38e994b70b32fb25d36a0f8c6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.422171 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0418e38e994b70b32fb25d36a0f8c6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.423811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0418e38e994b70b32fb25d36a0f8c6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.431158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0418e38e994b70b32fb25d36a0f8c6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.436217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:01.444351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ed931d93-9c23-407a-8532-521ea2e0f0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0418e38e994b70b32fb25d36a0f8c6'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.451230 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1303/2586] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:01 2022] DELETE /identity/v3/users/ab0418e38e994b70b32fb25d36a0f8c6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:01.725572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:01.727122 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:01.740012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005b80e-81a9-46ae-80e7-d462ea6a96b2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:01.752703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:01.800309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:01.800913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:01.801192 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:01.801465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] PATH_INFO: `/v3/projects/7b46f46e6b844a348c5a7e3c4bfcc911` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:01.802566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b46f46e6b844a348c5a7e3c4bfcc911)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:01.804522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:01.849127 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b46f46e6b844a348c5a7e3c4bfcc911', 'request_id': 'req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.855116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b46f46e6b844a348c5a7e3c4bfcc911', 'request_id': 'req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.861464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b46f46e6b844a348c5a7e3c4bfcc911', 'request_id': 'req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.874769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] The token cache is being invalidate because project 7b46f46e6b844a348c5a7e3c4bfcc911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:01.875117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.875736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c912d8d8-8bc8-4ecb-81fb-62d6c8b2fe2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:01.877253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1284/2587] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:01 2022] DELETE /identity/v3/projects/7b46f46e6b844a348c5a7e3c4bfcc911 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:01.882192 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0cd9-ba17-4fba-ba80-5279086c1298 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:01.882481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0cd9-ba17-4fba-ba80-5279086c1298 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:01.882756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0cd9-ba17-4fba-ba80-5279086c1298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:01.901891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a9ee0cd9-ba17-4fba-ba80-5279086c1298 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:01.903064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a9ee0cd9-ba17-4fba-ba80-5279086c1298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:01.960626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1304/2588] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:01.968213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a301a-e610-4424-af70-8874761b9770 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:01.968543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a301a-e610-4424-af70-8874761b9770 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:01.968853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a301a-e610-4424-af70-8874761b9770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:01.988567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bf7a301a-e610-4424-af70-8874761b9770 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:01.989761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bf7a301a-e610-4424-af70-8874761b9770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:01.998243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1285/2589] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:02.002590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0cd9-ba17-4fba-ba80-5279086c1298 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.011992 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0cd9-ba17-4fba-ba80-5279086c1298 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.016524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.017111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.017386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.017654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.018283 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:02.018581 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.020169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.031205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1305/2590] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:02.035339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a301a-e610-4424-af70-8874761b9770 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.045008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a301a-e610-4424-af70-8874761b9770 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.049644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.050256 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.050532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.050801 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.051417 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.053356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.082273 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1286/2591] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:02 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:02.086379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.096058 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d8d1-360d-408a-ac4c-79385ec7562d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.151087 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.151687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.151967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.152240 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.152892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.154788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.176018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1306/2592] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:02 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:02.180174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.190457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2820-daf6-4a48-aa0c-7eb9d920f7df admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.195065 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.195672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.196030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.196337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.196981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.198606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.208298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1287/2593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:02.212623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.222198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12252118-4c8a-4560-b734-ff7ce9260c69 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.226774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6185c-46fc-42fd-b2a6-23d665e63756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.227984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6185c-46fc-42fd-b2a6-23d665e63756 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.228262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6185c-46fc-42fd-b2a6-23d665e63756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.228566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6185c-46fc-42fd-b2a6-23d665e63756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.229212 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6185c-46fc-42fd-b2a6-23d665e63756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.230794 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6185c-46fc-42fd-b2a6-23d665e63756 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.241555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1307/2594] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:02.245561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.255548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e080354-f476-46b1-98c4-356dc992e140 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.260180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.260854 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.261141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.261422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] PATH_INFO: `/v3/projects/983a128a792a43bf8bddb766cc074b33/users/dacf18be6b0a4cc6a01812d88bf339a3/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.276067 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983a128a792a43bf8bddb766cc074b33, user_id=dacf18be6b0a4cc6a01812d88bf339a3, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.278774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.291756 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1288/2595] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:02 2022] PUT /identity/v3/projects/983a128a792a43bf8bddb766cc074b33/users/dacf18be6b0a4cc6a01812d88bf339a3/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:02.302945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbbba-782f-43b9-a6c1-224257c9d478 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.303421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbbba-782f-43b9-a6c1-224257c9d478 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.303519 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbbba-782f-43b9-a6c1-224257c9d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.330070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-320bbbba-782f-43b9-a6c1-224257c9d478 None None] MFA Rules not processed for user `dacf18be6b0a4cc6a01812d88bf339a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:02.331258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-320bbbba-782f-43b9-a6c1-224257c9d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:02.371823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:02.396264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1308/2596] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:02.401326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.445467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:02.465281 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88597-05bf-4fcc-95cd-d33ff78182e4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.469803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.470407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.470694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.470967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.471604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.473552 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.499882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1289/2597] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:02 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:02.503968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bbbba-782f-43b9-a6c1-224257c9d478 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.514888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bbbba-782f-43b9-a6c1-224257c9d478 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.569122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.569817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.570099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.570375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.571533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.573482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.599000 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1309/2598] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:02 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:02.600795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.611688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee6689-4bb8-4258-8708-6661588974cd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.616571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.617177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.617463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.617738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.618381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.619990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.630890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1290/2599] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:02.635507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.645312 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d2e7d-dd99-4a93-a24a-a4a40baf5fb5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.650559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.651204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.651484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.651761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] PATH_INFO: `/v3/projects/bcbcac8344694e08a9a30b388431b7fe/users/70cc953349b4484ca0a9c6c1b94520a2/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.666199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbcac8344694e08a9a30b388431b7fe, user_id=70cc953349b4484ca0a9c6c1b94520a2, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.668914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.682467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1310/2600] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:02 2022] PUT /identity/v3/projects/bcbcac8344694e08a9a30b388431b7fe/users/70cc953349b4484ca0a9c6c1b94520a2/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:02.686344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.696673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4e6da-c1fd-465a-a620-60b4e61e736d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.756934 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090aaa4-5c33-42d2-a290-30dfb34f43ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.757591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090aaa4-5c33-42d2-a290-30dfb34f43ca admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.757728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090aaa4-5c33-42d2-a290-30dfb34f43ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.758004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090aaa4-5c33-42d2-a290-30dfb34f43ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.759146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090aaa4-5c33-42d2-a290-30dfb34f43ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.760774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090aaa4-5c33-42d2-a290-30dfb34f43ca admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.770299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1291/2601] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:02.775413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.785607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487dd5-142d-4433-b882-7ad38555fd43 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.790425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.791078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.791360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.791635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] PATH_INFO: `/v3/projects/bcbcac8344694e08a9a30b388431b7fe/users/70cc953349b4484ca0a9c6c1b94520a2/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.793605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbcac8344694e08a9a30b388431b7fe, user_id=70cc953349b4484ca0a9c6c1b94520a2, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.796242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:02.806592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1311/2602] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:02 2022] PUT /identity/v3/projects/bcbcac8344694e08a9a30b388431b7fe/users/70cc953349b4484ca0a9c6c1b94520a2/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:02.816625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.816913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.817191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.845231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] MFA Rules not processed for user `70cc953349b4484ca0a9c6c1b94520a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:02.846445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:02.913541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1292/2603] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:02.924325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:02.926073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:02.982828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef2f3-586e-4b64-a3ba-0836dc31f0e0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:02.986563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:02.987164 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:02.987467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:02.987745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:02.997474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:02.999219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:03.009030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1312/2604] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:03.054883 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:03.057161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:03.070130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2dc05-38c3-41a7-b0e1-3a2cdd13b02d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:03.074374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2492e2-83b9-4db7-92fd-12ed8ff32012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:03.074976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2492e2-83b9-4db7-92fd-12ed8ff32012 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:03.075252 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2492e2-83b9-4db7-92fd-12ed8ff32012 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:03.075521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2492e2-83b9-4db7-92fd-12ed8ff32012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:03.109383 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:03.135240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2492e2-83b9-4db7-92fd-12ed8ff32012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:03.136718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2492e2-83b9-4db7-92fd-12ed8ff32012 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:03.145330 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1293/2605] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:06.412870 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:06.453106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:06.475551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27345-67e8-43dc-8ec6-76b3f625e5c8 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:06.480587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:06.481208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:06.481484 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:06.481753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] PATH_INFO: `/v3/users/dacf18be6b0a4cc6a01812d88bf339a3` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:06.482855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dacf18be6b0a4cc6a01812d88bf339a3)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:06.484805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:06.529251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dacf18be6b0a4cc6a01812d88bf339a3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:06.536942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dacf18be6b0a4cc6a01812d88bf339a3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:06.537714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dacf18be6b0a4cc6a01812d88bf339a3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:06.545231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dacf18be6b0a4cc6a01812d88bf339a3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:06.557475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dacf18be6b0a4cc6a01812d88bf339a3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:06.563309 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1313/2606] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:06 2022] DELETE /identity/v3/users/dacf18be6b0a4cc6a01812d88bf339a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:06.567942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acb065-a367-46ee-b804-399746a40372 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:06.568446 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acb065-a367-46ee-b804-399746a40372 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:06.568557 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acb065-a367-46ee-b804-399746a40372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:06.587074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-91acb065-a367-46ee-b804-399746a40372 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:06.588272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-91acb065-a367-46ee-b804-399746a40372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:06.644803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1294/2607] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:06.654838 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:06.656229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:06.712575 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a4795-1d92-4d2c-bae1-3443bf50b5a7 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:06.716189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:06.716831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:06.717095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:06.717365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:06.726033 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:06.728040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:06.737288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1314/2608] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:06.995421 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acb065-a367-46ee-b804-399746a40372 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:06.996879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-91acb065-a367-46ee-b804-399746a40372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:07.009469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acb065-a367-46ee-b804-399746a40372 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:07.014023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:07.014661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.014939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.015212 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] PATH_INFO: `/v3/projects/983a128a792a43bf8bddb766cc074b33` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.016480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983a128a792a43bf8bddb766cc074b33)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:07.018426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:07.068405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983a128a792a43bf8bddb766cc074b33', 'request_id': 'req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.074562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983a128a792a43bf8bddb766cc074b33', 'request_id': 'req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.080714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983a128a792a43bf8bddb766cc074b33', 'request_id': 'req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.093588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] The token cache is being invalidate because project 983a128a792a43bf8bddb766cc074b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:07.093924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.094516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.095977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1295/2609] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:06 2022] DELETE /identity/v3/projects/983a128a792a43bf8bddb766cc074b33 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:07.099920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:07.109486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9565f69-27a3-4a84-981b-bde453a69766 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:07.167185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:07.167816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.168094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.168402 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] PATH_INFO: `/v3/users/70cc953349b4484ca0a9c6c1b94520a2` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.169517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cc953349b4484ca0a9c6c1b94520a2)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:07.171432 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:07.172893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:07.218910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cc953349b4484ca0a9c6c1b94520a2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.225984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cc953349b4484ca0a9c6c1b94520a2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.226820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cc953349b4484ca0a9c6c1b94520a2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.233657 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cc953349b4484ca0a9c6c1b94520a2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.245094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-236b21b8-0d4a-490e-bf5a-281bff6ff8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cc953349b4484ca0a9c6c1b94520a2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.251023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1315/2610] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:07 2022] DELETE /identity/v3/users/70cc953349b4484ca0a9c6c1b94520a2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:07.513913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:07.515373 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:07.528539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1435f0f-3d04-4054-a24a-d0d75c0e5ab3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:07.589826 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:07.590473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.590718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.590985 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] PATH_INFO: `/v3/projects/bcbcac8344694e08a9a30b388431b7fe` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.592090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbcac8344694e08a9a30b388431b7fe)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:07.594028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:07.595462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:07.642634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbcac8344694e08a9a30b388431b7fe', 'request_id': 'req-be700aa4-d134-47e1-a4ac-03d463a779ec'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.647882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbcac8344694e08a9a30b388431b7fe', 'request_id': 'req-be700aa4-d134-47e1-a4ac-03d463a779ec'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.654041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbcac8344694e08a9a30b388431b7fe', 'request_id': 'req-be700aa4-d134-47e1-a4ac-03d463a779ec'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.666006 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] The token cache is being invalidate because project bcbcac8344694e08a9a30b388431b7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:07.666296 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.666913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-be700aa4-d134-47e1-a4ac-03d463a779ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:07.668403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1296/2611] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:07 2022] DELETE /identity/v3/projects/bcbcac8344694e08a9a30b388431b7fe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:07.673980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e90722-0d6f-4feb-ad03-19e68b6458db None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.674460 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e90722-0d6f-4feb-ad03-19e68b6458db None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.674562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e90722-0d6f-4feb-ad03-19e68b6458db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.694353 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-78e90722-0d6f-4feb-ad03-19e68b6458db None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:07.695554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-78e90722-0d6f-4feb-ad03-19e68b6458db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:07.754021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1316/2612] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:07.761640 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54c26a-7ff9-4d6f-93ac-75cf2a951b18 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.761932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54c26a-7ff9-4d6f-93ac-75cf2a951b18 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.762213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54c26a-7ff9-4d6f-93ac-75cf2a951b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.781397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6a54c26a-7ff9-4d6f-93ac-75cf2a951b18 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:07.782599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6a54c26a-7ff9-4d6f-93ac-75cf2a951b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:07.790920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1297/2613] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:07.794912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e90722-0d6f-4feb-ad03-19e68b6458db None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:07.804397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e90722-0d6f-4feb-ad03-19e68b6458db None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:07.809516 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:07.810112 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.810393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.810669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.811332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:07.811622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:07.813250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:07.824471 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1317/2614] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:07.828513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54c26a-7ff9-4d6f-93ac-75cf2a951b18 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:07.837423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54c26a-7ff9-4d6f-93ac-75cf2a951b18 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:07.842050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:07.842644 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.842918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.843187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.843813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:07.845802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:07.874024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1298/2615] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:07 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:07.878304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:07.888431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee47a3-6e55-4c86-8588-ac2b03d50999 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:07.943250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:07.943786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.944067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.944372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.945013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:07.946953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:07.957711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:07.968965 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1318/2616] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:07 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:07.973066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:07.983702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e873-b43d-4111-b201-42143768a2a8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:07.988193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:07.988811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:07.989086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:07.989355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:07.989982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:07.991592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:08.004381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1299/2617] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:08.006435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:08.016209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66847eb-e7cc-47d6-a7d2-505b7c9573d6 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:08.020723 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76bd2a-93c5-48a3-b12d-651d3812f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:08.021310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76bd2a-93c5-48a3-b12d-651d3812f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:08.021590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76bd2a-93c5-48a3-b12d-651d3812f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:08.021869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76bd2a-93c5-48a3-b12d-651d3812f0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:08.022503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76bd2a-93c5-48a3-b12d-651d3812f0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:08.024066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76bd2a-93c5-48a3-b12d-651d3812f0b3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:08.034251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1319/2618] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:08.038132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:08.048561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1b9a6-7e27-4366-9448-1d9a78744abb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:08.053141 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:08.053782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:08.054064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:08.054340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] PATH_INFO: `/v3/projects/4ed3f61ba95142cab7a6d44c089e70be/users/fd95a7b8388a4ab2bf2e5e4dd290d837/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:08.069221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed3f61ba95142cab7a6d44c089e70be, user_id=fd95a7b8388a4ab2bf2e5e4dd290d837, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:08.072286 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:08.085246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1300/2619] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:08 2022] PUT /identity/v3/projects/4ed3f61ba95142cab7a6d44c089e70be/users/fd95a7b8388a4ab2bf2e5e4dd290d837/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:08.097167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c23d38-1697-4ee0-917f-4fd00a5a70a2 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:08.097459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c23d38-1697-4ee0-917f-4fd00a5a70a2 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:08.097791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c23d38-1697-4ee0-917f-4fd00a5a70a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:08.126585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c1c23d38-1697-4ee0-917f-4fd00a5a70a2 None None] MFA Rules not processed for user `fd95a7b8388a4ab2bf2e5e4dd290d837`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:08.127820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c1c23d38-1697-4ee0-917f-4fd00a5a70a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:08.189851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1320/2620] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:08.200725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:08.202374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:08.258308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdabb-b882-4997-80b4-6f417048d067 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:08.262002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926411-02ac-4355-a55a-ae3cb66fbf10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:08.262604 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926411-02ac-4355-a55a-ae3cb66fbf10 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:08.262888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926411-02ac-4355-a55a-ae3cb66fbf10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:08.263164 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926411-02ac-4355-a55a-ae3cb66fbf10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:08.271236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926411-02ac-4355-a55a-ae3cb66fbf10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:08.272727 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926411-02ac-4355-a55a-ae3cb66fbf10 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:08.281915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1301/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:13.580752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c23d38-1697-4ee0-917f-4fd00a5a70a2 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:13.643644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c23d38-1697-4ee0-917f-4fd00a5a70a2 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:13.648163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:13.648831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:13.649114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:13.649393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] PATH_INFO: `/v3/users/fd95a7b8388a4ab2bf2e5e4dd290d837` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:13.651069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd95a7b8388a4ab2bf2e5e4dd290d837)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:13.653048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:13.709691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd95a7b8388a4ab2bf2e5e4dd290d837'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:13.722315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd95a7b8388a4ab2bf2e5e4dd290d837'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:13.723257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd95a7b8388a4ab2bf2e5e4dd290d837'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:13.733274 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd95a7b8388a4ab2bf2e5e4dd290d837'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:13.746476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:13.749646 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd95a7b8388a4ab2bf2e5e4dd290d837'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:13.761569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1321/2622] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:13 2022] DELETE /identity/v3/users/fd95a7b8388a4ab2bf2e5e4dd290d837 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:37:13.762950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:13.763409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:13.763507 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:13.801831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:13.803206 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:13.851722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:13.903076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1302/2623] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:13.913873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:13.915347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:14.000707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e8c25-15d6-4d4e-a411-b736ea46a7fc admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:14.004383 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4283d-eefb-426b-adc5-023a9ffce1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:14.005005 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4283d-eefb-426b-adc5-023a9ffce1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.005303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4283d-eefb-426b-adc5-023a9ffce1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.005578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4283d-eefb-426b-adc5-023a9ffce1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.015714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4283d-eefb-426b-adc5-023a9ffce1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:14.017476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4283d-eefb-426b-adc5-023a9ffce1e4 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:14.027851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1322/2624] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:14.327485 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:14.330571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:14.368456 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65234e-fd32-4b92-a194-4df4655d092d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:14.376083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:14.376775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.377064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.377345 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] PATH_INFO: `/v3/projects/4ed3f61ba95142cab7a6d44c089e70be` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.379043 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed3f61ba95142cab7a6d44c089e70be)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:14.380848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:14.440784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed3f61ba95142cab7a6d44c089e70be', 'request_id': 'req-f1849c4a-7f96-4420-aa5b-d1589c6d4200'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:14.446433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed3f61ba95142cab7a6d44c089e70be', 'request_id': 'req-f1849c4a-7f96-4420-aa5b-d1589c6d4200'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:14.453947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed3f61ba95142cab7a6d44c089e70be', 'request_id': 'req-f1849c4a-7f96-4420-aa5b-d1589c6d4200'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:14.468183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] The token cache is being invalidate because project 4ed3f61ba95142cab7a6d44c089e70be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:14.468514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:14.469583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f1849c4a-7f96-4420-aa5b-d1589c6d4200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:14.472348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1303/2625] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:14 2022] DELETE /identity/v3/projects/4ed3f61ba95142cab7a6d44c089e70be => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:14.476752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b59d9-d03e-4479-88c1-bc94437b30f9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.477048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b59d9-d03e-4479-88c1-bc94437b30f9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.477329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b59d9-d03e-4479-88c1-bc94437b30f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.498080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7d1b59d9-d03e-4479-88c1-bc94437b30f9 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:14.499585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7d1b59d9-d03e-4479-88c1-bc94437b30f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:14.562787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1323/2626] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:14.570539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44c568-3911-4d65-9a4d-57b199d5683f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.570827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44c568-3911-4d65-9a4d-57b199d5683f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.571100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44c568-3911-4d65-9a4d-57b199d5683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.715922 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-8d44c568-3911-4d65-9a4d-57b199d5683f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:14.717245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8d44c568-3911-4d65-9a4d-57b199d5683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:14.726108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1304/2627] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:14.732470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b59d9-d03e-4479-88c1-bc94437b30f9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:14.742730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b59d9-d03e-4479-88c1-bc94437b30f9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:14.750759 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:14.751824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.752376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.752730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.753424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:14.753727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:14.755338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:14.768836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1324/2628] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:14.774378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44c568-3911-4d65-9a4d-57b199d5683f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:14.784272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44c568-3911-4d65-9a4d-57b199d5683f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:14.789380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:14.789968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.790318 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.790541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.791876 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:14.793976 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:14.827981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1305/2629] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:14 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:14.828846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:14.839531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd31b-dc8e-44c6-88b5-e57f6593dd4e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:14.918400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:14.919024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.919329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.919605 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.920255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:14.922324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:14.942734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1325/2630] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:14 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:14.946971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:14.957072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd312-fd88-40d7-902c-28c1baa16cfe admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:14.961637 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:14.962230 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.962509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.962780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.963926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:14.965595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:14.975133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1306/2631] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:14.979559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:14.989428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11bdf-54c8-4a50-8591-06e930d8a803 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:14.994074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389cfa1-787f-408f-9678-c9bf19a108f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:14.994683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389cfa1-787f-408f-9678-c9bf19a108f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:14.994973 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389cfa1-787f-408f-9678-c9bf19a108f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:14.995251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389cfa1-787f-408f-9678-c9bf19a108f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:14.995914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389cfa1-787f-408f-9678-c9bf19a108f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:14.997647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389cfa1-787f-408f-9678-c9bf19a108f3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:15.008310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1326/2632] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:15.012203 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:15.021886 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456d659-75d4-4e12-ae96-faf7818103e6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:15.026905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:15.027540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:15.027820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:15.028093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] PATH_INFO: `/v3/projects/bd490bbbcd704e2bb2caf8f2a31d84a6/users/2606f8015fcc4c19a7b51492bc453829/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:15.042694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd490bbbcd704e2bb2caf8f2a31d84a6, user_id=2606f8015fcc4c19a7b51492bc453829, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:15.045369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:15.058774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1307/2633] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:15 2022] PUT /identity/v3/projects/bd490bbbcd704e2bb2caf8f2a31d84a6/users/2606f8015fcc4c19a7b51492bc453829/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:15.070002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:15.070289 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:15.070564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:15.077700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:15.103069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] MFA Rules not processed for user `2606f8015fcc4c19a7b51492bc453829`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:15.105451 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:15.181346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1327/2634] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:15.192906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:15.194577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:15.245753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:15.250008 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e171fc0-a3ae-44e1-b18d-07376455a9bd admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:15.254718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280ee7087f43a3a7e4c4940a8f23af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:15.255391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:15.255920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:15.256409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:15.265293 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:15.266744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:15.275231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1308/2635] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:18.611108 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:18.612536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:18.670284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbdca4-3207-4255-9bdc-a2a4aa4bacec None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:18.674011 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:18.674700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:18.675055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:18.675331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:18.677500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:18.738236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:18.739662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:18.749871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1328/2636] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:21.662966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:21.665108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:21.683338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497360b-1906-4503-871d-2c1b3174808c service glance] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:21.688325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:21.688848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:21.689124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:21.689395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] PATH_INFO: `/v3/users/b6a423b67e4440628fe967429698a603` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:21.690612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a423b67e4440628fe967429698a603)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:21.692701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:21.742475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a423b67e4440628fe967429698a603'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:21.750877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a423b67e4440628fe967429698a603'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:21.751489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a423b67e4440628fe967429698a603'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:21.763536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a423b67e4440628fe967429698a603'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:21.770387 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-37e40888-e3d3-48c2-8872-1f703c68694b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a423b67e4440628fe967429698a603'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:21.776732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1309/2637] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:21 2022] DELETE /identity/v3/users/b6a423b67e4440628fe967429698a603 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:21.950673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:21.960586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad586f-bfd0-4410-a40d-8b78092eaeb6 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.001027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:22.017891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.018528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.018812 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.019089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] PATH_INFO: `/v3/projects/f4b251489ecf4f53aa67a28445ab1b97` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.020210 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b251489ecf4f53aa67a28445ab1b97)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.022148 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.071949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b251489ecf4f53aa67a28445ab1b97', 'request_id': 'req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:22.079928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b251489ecf4f53aa67a28445ab1b97', 'request_id': 'req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:22.085882 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b251489ecf4f53aa67a28445ab1b97', 'request_id': 'req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:22.097645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] The token cache is being invalidate because project f4b251489ecf4f53aa67a28445ab1b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:22.097935 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:22.098607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-36ccb473-7a8d-4e8b-9e7a-eb60f6db18e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:22.100085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1329/2638] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:21 2022] DELETE /identity/v3/projects/f4b251489ecf4f53aa67a28445ab1b97 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:22.104963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462fb86-1d07-4aac-963e-d34865664044 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.105245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462fb86-1d07-4aac-963e-d34865664044 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.105515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462fb86-1d07-4aac-963e-d34865664044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.124739 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-2462fb86-1d07-4aac-963e-d34865664044 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:22.125917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-2462fb86-1d07-4aac-963e-d34865664044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:22.186240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1310/2639] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:22.194107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df942f-6ce3-490c-9057-1d44ec846f19 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.194391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df942f-6ce3-490c-9057-1d44ec846f19 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.194665 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df942f-6ce3-490c-9057-1d44ec846f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.215485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-a4df942f-6ce3-490c-9057-1d44ec846f19 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:22.216741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a4df942f-6ce3-490c-9057-1d44ec846f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:22.224618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1330/2640] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:22.228601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462fb86-1d07-4aac-963e-d34865664044 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.238179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462fb86-1d07-4aac-963e-d34865664044 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.242628 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.243219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.243496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.243772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.244439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:22.244738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.246305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.257693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1311/2641] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:22.262271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df942f-6ce3-490c-9057-1d44ec846f19 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.271252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df942f-6ce3-490c-9057-1d44ec846f19 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.276577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.277168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.277450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.277726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.278346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.280232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.309303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1331/2642] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:22 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:22.313560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.323996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8662d-03cf-44aa-a863-7115cd3e9734 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.368653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:22.380618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.381213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.381491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.381771 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.382370 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.384291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.407984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1312/2643] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:22 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:22.412129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.422252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6f27-3486-4a90-8bdf-be244431cf51 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.426800 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.427391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.427671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.427939 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.428612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.430196 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.440694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1332/2644] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:22.444707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.455038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55944-34ae-493c-b0f2-d8b6a33a8d8b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.459555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bae40-6de2-41b4-9067-b6a7a9595656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.460137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bae40-6de2-41b4-9067-b6a7a9595656 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.460445 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bae40-6de2-41b4-9067-b6a7a9595656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.460713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bae40-6de2-41b4-9067-b6a7a9595656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.461336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bae40-6de2-41b4-9067-b6a7a9595656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.462915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bae40-6de2-41b4-9067-b6a7a9595656 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.472531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1313/2645] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:22.476429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.485994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3473cf-1691-4bc4-b401-411d5c7ac239 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.490540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.491172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.491449 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.491719 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] PATH_INFO: `/v3/projects/8985504e9c4a49f8b6c209e027783bd7/users/75fc05d5eb0c45539ffdeda610aca5b7/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.507002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8985504e9c4a49f8b6c209e027783bd7, user_id=75fc05d5eb0c45539ffdeda610aca5b7, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.509766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.525293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1333/2646] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:22 2022] PUT /identity/v3/projects/8985504e9c4a49f8b6c209e027783bd7/users/75fc05d5eb0c45539ffdeda610aca5b7/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:22.535848 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705923-9a51-4c44-aa38-2338579f4711 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.536139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705923-9a51-4c44-aa38-2338579f4711 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.536462 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01705923-9a51-4c44-aa38-2338579f4711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.563675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-01705923-9a51-4c44-aa38-2338579f4711 None None] MFA Rules not processed for user `75fc05d5eb0c45539ffdeda610aca5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:22.564911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-01705923-9a51-4c44-aa38-2338579f4711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:22.627215 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1314/2647] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:22.631988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.696958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0658b-5212-45b2-8166-f7ff9a795774 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.701678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.702280 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.702565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.702839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.703482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.705428 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.719173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:22.736686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1334/2648] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:22 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:22.737788 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01705923-9a51-4c44-aa38-2338579f4711 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.749754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01705923-9a51-4c44-aa38-2338579f4711 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.806787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.807942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.808218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.808516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.809140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.811039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.830566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1315/2649] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:22 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:22.834565 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.845045 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dade3-9993-4440-bacf-5b3fbc159fe0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.849634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.850232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.850504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.850772 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.851405 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.853026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.867828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1335/2650] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:22.872609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.882573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91563-9c25-4b7c-8f44-e253b320a82e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.887089 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.887734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.888010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.888308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] PATH_INFO: `/v3/projects/7e00faa5c4dc45aa838c9fbc50535bf5/users/05c17a78314b46159e72b5ac3f62b96f/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.907905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e00faa5c4dc45aa838c9fbc50535bf5, user_id=05c17a78314b46159e72b5ac3f62b96f, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.911034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:22.924153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1316/2651] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:22 2022] PUT /identity/v3/projects/7e00faa5c4dc45aa838c9fbc50535bf5/users/05c17a78314b46159e72b5ac3f62b96f/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:22.928202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:22.939034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189d829-aae9-466d-8afa-10c4d5f6eb3d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:22.995179 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa55c8b-e107-41d0-b434-30bd0e03ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:22.995819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55c8b-e107-41d0-b434-30bd0e03ae62 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:22.996080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55c8b-e107-41d0-b434-30bd0e03ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:22.996380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55c8b-e107-41d0-b434-30bd0e03ae62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:22.997019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa55c8b-e107-41d0-b434-30bd0e03ae62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:22.998900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa55c8b-e107-41d0-b434-30bd0e03ae62 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:23.008765 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1336/2652] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:23.012970 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:23.022915 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e040-6e58-423f-99be-f3b8ae4a532e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:23.028157 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:23.028963 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:23.029244 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:23.029516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] PATH_INFO: `/v3/projects/7e00faa5c4dc45aa838c9fbc50535bf5/users/05c17a78314b46159e72b5ac3f62b96f/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:23.031760 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e00faa5c4dc45aa838c9fbc50535bf5, user_id=05c17a78314b46159e72b5ac3f62b96f, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:23.034948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:23.046926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1317/2653] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:23 2022] PUT /identity/v3/projects/7e00faa5c4dc45aa838c9fbc50535bf5/users/05c17a78314b46159e72b5ac3f62b96f/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:23.059327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166885ab-04c8-418c-9e4a-e01582b8ed6d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:23.059613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166885ab-04c8-418c-9e4a-e01582b8ed6d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:23.059885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166885ab-04c8-418c-9e4a-e01582b8ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:23.087437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-166885ab-04c8-418c-9e4a-e01582b8ed6d None None] MFA Rules not processed for user `05c17a78314b46159e72b5ac3f62b96f`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:23.089163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-166885ab-04c8-418c-9e4a-e01582b8ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:23.159525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1337/2654] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:23.173863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:23.175838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:23.190051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:23.233920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09377-2c57-4592-adf2-42289053532d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:23.237500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d7a1-9360-4d7f-8ed4-52a9b4ba69b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:23.238096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d7a1-9360-4d7f-8ed4-52a9b4ba69b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:23.238375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d7a1-9360-4d7f-8ed4-52a9b4ba69b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:23.238646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d7a1-9360-4d7f-8ed4-52a9b4ba69b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:23.247496 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d7a1-9360-4d7f-8ed4-52a9b4ba69b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:23.249225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d7a1-9360-4d7f-8ed4-52a9b4ba69b1 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:23.258384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1318/2655] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:23 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:23.413711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166885ab-04c8-418c-9e4a-e01582b8ed6d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:23.477995 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166885ab-04c8-418c-9e4a-e01582b8ed6d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:23.482525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:23.483150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:23.483426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:23.483766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] PATH_INFO: `/v3/users/75fc05d5eb0c45539ffdeda610aca5b7` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:23.484863 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fc05d5eb0c45539ffdeda610aca5b7)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:23.486766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:23.491169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:23.538806 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fc05d5eb0c45539ffdeda610aca5b7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:23.546384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fc05d5eb0c45539ffdeda610aca5b7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:23.547582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fc05d5eb0c45539ffdeda610aca5b7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:23.556249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fc05d5eb0c45539ffdeda610aca5b7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:23.568811 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fc05d5eb0c45539ffdeda610aca5b7'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:23.575501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1338/2656] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:23 2022] DELETE /identity/v3/users/75fc05d5eb0c45539ffdeda610aca5b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:23.580052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:23.580375 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:23.580650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:23.599269 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:23.600464 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:23.657723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1319/2657] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:23.667694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:23.669357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:23.729714 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309f7d7-23ce-410f-91a4-3e76f28f2d4a admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:23.733394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:23.734004 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:23.734284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:23.734559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:23.743211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:23.744684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:23.754081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1339/2658] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:24.046102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:24.049092 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:24.063078 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad599d-0599-40d4-baa5-30f897a9841a None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:24.068196 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:24.068862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:24.069299 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:24.069577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] PATH_INFO: `/v3/projects/8985504e9c4a49f8b6c209e027783bd7` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:24.070711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8985504e9c4a49f8b6c209e027783bd7)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:24.072723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:24.124674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8985504e9c4a49f8b6c209e027783bd7', 'request_id': 'req-a1d04c15-5826-4703-b462-6e24e2680cda'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.130120 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8985504e9c4a49f8b6c209e027783bd7', 'request_id': 'req-a1d04c15-5826-4703-b462-6e24e2680cda'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.136691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8985504e9c4a49f8b6c209e027783bd7', 'request_id': 'req-a1d04c15-5826-4703-b462-6e24e2680cda'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.150260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] The token cache is being invalidate because project 8985504e9c4a49f8b6c209e027783bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:24.150260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.150260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.151243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1320/2659] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:24 2022] DELETE /identity/v3/projects/8985504e9c4a49f8b6c209e027783bd7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:24.155754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:24.165549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dbba-5617-43a5-90ad-4f16b958e4ad service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:24.227761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:24.228443 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:24.228727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:24.229002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] PATH_INFO: `/v3/users/05c17a78314b46159e72b5ac3f62b96f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:24.230136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c17a78314b46159e72b5ac3f62b96f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:24.232095 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:24.261024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:24.280631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c17a78314b46159e72b5ac3f62b96f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.287654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c17a78314b46159e72b5ac3f62b96f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.288359 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c17a78314b46159e72b5ac3f62b96f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.296121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c17a78314b46159e72b5ac3f62b96f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.313614 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-6e7f1a1d-c7b7-4836-aaf0-a8552023c707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c17a78314b46159e72b5ac3f62b96f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.319633 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1340/2660] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:24 2022] DELETE /identity/v3/users/05c17a78314b46159e72b5ac3f62b96f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:24.585047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:24.586486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:24.599190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d04c15-5826-4703-b462-6e24e2680cda admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:24.633007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:24.656862 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:24.657493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:24.657779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:24.658050 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] PATH_INFO: `/v3/projects/7e00faa5c4dc45aa838c9fbc50535bf5` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:24.659159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e00faa5c4dc45aa838c9fbc50535bf5)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:24.661104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:24.714779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e00faa5c4dc45aa838c9fbc50535bf5', 'request_id': 'req-9710c25c-b017-40e0-8769-73832b0f4686'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.714779 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e00faa5c4dc45aa838c9fbc50535bf5', 'request_id': 'req-9710c25c-b017-40e0-8769-73832b0f4686'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.720094 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e00faa5c4dc45aa838c9fbc50535bf5', 'request_id': 'req-9710c25c-b017-40e0-8769-73832b0f4686'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.732816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] The token cache is being invalidate because project 7e00faa5c4dc45aa838c9fbc50535bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:24.733132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.733745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9710c25c-b017-40e0-8769-73832b0f4686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:24.735200 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1321/2661] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:24 2022] DELETE /identity/v3/projects/7e00faa5c4dc45aa838c9fbc50535bf5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:24.740006 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22819-e7f8-46e0-8171-da3aea1f4619 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:24.740315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22819-e7f8-46e0-8171-da3aea1f4619 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:24.740610 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22819-e7f8-46e0-8171-da3aea1f4619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:24.760216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d3f22819-e7f8-46e0-8171-da3aea1f4619 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:24.761967 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d3f22819-e7f8-46e0-8171-da3aea1f4619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:24.818611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1341/2662] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:24.827525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfb518-75d3-4bf8-a07d-e1afbcccd941 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:24.827897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfb518-75d3-4bf8-a07d-e1afbcccd941 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:24.828180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfb518-75d3-4bf8-a07d-e1afbcccd941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:24.848583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cbdfb518-75d3-4bf8-a07d-e1afbcccd941 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:24.849762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cbdfb518-75d3-4bf8-a07d-e1afbcccd941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:24.857488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1322/2663] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:24.861855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f22819-e7f8-46e0-8171-da3aea1f4619 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:24.871996 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f22819-e7f8-46e0-8171-da3aea1f4619 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:24.876801 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:24.877389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:24.877669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:24.877937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:24.878577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:24.878875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:24.880497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:24.892556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1342/2664] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:24.896879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfb518-75d3-4bf8-a07d-e1afbcccd941 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:24.905868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfb518-75d3-4bf8-a07d-e1afbcccd941 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:24.910363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:24.910946 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:24.911219 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:24.911489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:24.912116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:24.914021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:24.941455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1323/2665] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:24 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:24.945497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:24.956354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cd26-e426-4338-9ef3-f141574db292 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:25.014613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:25.015133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.015411 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.015681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.016345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:25.018281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:25.038644 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1343/2666] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:24 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:25.043265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:25.053218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e7e1-4d6a-4340-a12c-b616d41d6c27 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:25.057728 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:25.058935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.059213 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.059481 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.060105 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:25.061865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:25.072117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1324/2667] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:25.076578 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:25.086823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f503-efa4-416b-af3d-69fcf0aa5755 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:25.091399 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cd93b-ef6a-495b-ae1c-f917d02275c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:25.091998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cd93b-ef6a-495b-ae1c-f917d02275c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.092343 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cd93b-ef6a-495b-ae1c-f917d02275c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.092621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cd93b-ef6a-495b-ae1c-f917d02275c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.093262 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cd93b-ef6a-495b-ae1c-f917d02275c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:25.094839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cd93b-ef6a-495b-ae1c-f917d02275c9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:25.105687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1344/2668] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:25.109896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:25.119918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e911b9-e68f-44d4-bf37-a42ef8b1e884 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:25.125384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:25.126024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.126304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.126598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] PATH_INFO: `/v3/projects/2a2de0bc0da644699dc6513ff23851c3/users/72962a12344a4fd1a21ae7e7d86b1a6e/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.142181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2de0bc0da644699dc6513ff23851c3, user_id=72962a12344a4fd1a21ae7e7d86b1a6e, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:25.145034 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:25.157207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1325/2669] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:25 2022] PUT /identity/v3/projects/2a2de0bc0da644699dc6513ff23851c3/users/72962a12344a4fd1a21ae7e7d86b1a6e/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:37:25.167333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1adc1-5b7e-478a-ae25-661ff189499c None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.168300 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1adc1-5b7e-478a-ae25-661ff189499c None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.168452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1adc1-5b7e-478a-ae25-661ff189499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.189050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:25.197711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e6d1adc1-5b7e-478a-ae25-661ff189499c None None] MFA Rules not processed for user `72962a12344a4fd1a21ae7e7d86b1a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:25.203149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e6d1adc1-5b7e-478a-ae25-661ff189499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:25.276611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1345/2670] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:25.288029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:25.289735 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:25.350132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fb326-c838-48f9-b55a-5f8e17a86904 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:25.353702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c528c22-97c5-4a36-9e85-95006a9c977f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:25.354307 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528c22-97c5-4a36-9e85-95006a9c977f service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.354586 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528c22-97c5-4a36-9e85-95006a9c977f service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.354857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528c22-97c5-4a36-9e85-95006a9c977f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.363635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c528c22-97c5-4a36-9e85-95006a9c977f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:25.365091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c528c22-97c5-4a36-9e85-95006a9c977f service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:25.373741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1326/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:25.395065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1adc1-5b7e-478a-ae25-661ff189499c None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:25.456437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1adc1-5b7e-478a-ae25-661ff189499c None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:25.461025 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:25.461652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.461931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.462209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] PATH_INFO: `/v3/users/72962a12344a4fd1a21ae7e7d86b1a6e` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.463439 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72962a12344a4fd1a21ae7e7d86b1a6e)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:25.466014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:25.514704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72962a12344a4fd1a21ae7e7d86b1a6e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:25.521650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72962a12344a4fd1a21ae7e7d86b1a6e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:25.522401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72962a12344a4fd1a21ae7e7d86b1a6e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:25.529958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72962a12344a4fd1a21ae7e7d86b1a6e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:25.541547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72962a12344a4fd1a21ae7e7d86b1a6e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:25.547963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1346/2672] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:25 2022] DELETE /identity/v3/users/72962a12344a4fd1a21ae7e7d86b1a6e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:25.552603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.552888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.553161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.565772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:25.572706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:25.574551 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:25.633574 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1327/2673] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:25.643745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:25.645171 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:25.669010 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:25.707227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4974e-c51e-4d39-9199-6c533c402cf9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:25.710915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3a426-cfb4-41f3-b410-3aecff20df3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:25.711517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3a426-cfb4-41f3-b410-3aecff20df3f service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:25.711799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3a426-cfb4-41f3-b410-3aecff20df3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:25.712075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3a426-cfb4-41f3-b410-3aecff20df3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:25.721685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3a426-cfb4-41f3-b410-3aecff20df3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:25.723130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3a426-cfb4-41f3-b410-3aecff20df3f service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:25.733356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1347/2674] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:26.006422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.007857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:26.020702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76c49-559d-48f8-86da-46a5ebd69d31 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.025251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.025882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.026156 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.026427 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] PATH_INFO: `/v3/projects/2a2de0bc0da644699dc6513ff23851c3` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.028250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2de0bc0da644699dc6513ff23851c3)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.030194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.076700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2de0bc0da644699dc6513ff23851c3', 'request_id': 'req-300f40b8-bab2-4057-97f1-2bb7934cdd58'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:26.082647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2de0bc0da644699dc6513ff23851c3', 'request_id': 'req-300f40b8-bab2-4057-97f1-2bb7934cdd58'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:26.089207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2de0bc0da644699dc6513ff23851c3', 'request_id': 'req-300f40b8-bab2-4057-97f1-2bb7934cdd58'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:26.102013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] The token cache is being invalidate because project 2a2de0bc0da644699dc6513ff23851c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:26.102304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:26.103068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-300f40b8-bab2-4057-97f1-2bb7934cdd58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:26.104675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1328/2675] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:26 2022] DELETE /identity/v3/projects/2a2de0bc0da644699dc6513ff23851c3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:37:26.109674 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fded62-248d-4f62-92db-c33ade938f07 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.109958 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fded62-248d-4f62-92db-c33ade938f07 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.110231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fded62-248d-4f62-92db-c33ade938f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.129903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-98fded62-248d-4f62-92db-c33ade938f07 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:26.131078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-98fded62-248d-4f62-92db-c33ade938f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:26.187621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1348/2676] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:26.196547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9a48f-7bfb-401c-a2e8-a30f08bd054d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.196835 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9a48f-7bfb-401c-a2e8-a30f08bd054d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.197110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9a48f-7bfb-401c-a2e8-a30f08bd054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.216929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4cc9a48f-7bfb-401c-a2e8-a30f08bd054d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:26.218117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4cc9a48f-7bfb-401c-a2e8-a30f08bd054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:26.225794 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1329/2677] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:26.229819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fded62-248d-4f62-92db-c33ade938f07 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.239455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fded62-248d-4f62-92db-c33ade938f07 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.243986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.244647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.244929 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.245204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.246340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:26.246659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.248219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.265632 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1349/2678] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:26.266539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9a48f-7bfb-401c-a2e8-a30f08bd054d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.275761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9a48f-7bfb-401c-a2e8-a30f08bd054d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.280669 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.281368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.281542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.281815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.282468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.284340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.317128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1330/2679] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:26 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:26.318229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.328523 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58dbd-885b-423c-922c-a58194e47001 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.383502 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.384080 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.384396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.384672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.385340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.387916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.408544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1350/2680] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:26 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:26.412782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.423233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d9aaf-d2e6-453f-a733-a1c9061de8d7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.427717 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.428334 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.428614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.428882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.429516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.431102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.441423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1331/2681] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:26.445414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.455858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfafb70-14c7-43ca-86b0-4698e0239dee admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.460534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747407f-3502-4b66-b632-1cb45f1aade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.461133 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747407f-3502-4b66-b632-1cb45f1aade9 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.461422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747407f-3502-4b66-b632-1cb45f1aade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.461695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747407f-3502-4b66-b632-1cb45f1aade9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.462335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747407f-3502-4b66-b632-1cb45f1aade9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.463918 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747407f-3502-4b66-b632-1cb45f1aade9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.474284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1351/2682] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:26.478455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.488869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2f53-6886-4d60-84b8-50b29a1fc628 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.493368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.494009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.494284 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.494555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] PATH_INFO: `/v3/projects/ff29a16144094ac48b367879e8acb7a4/users/2e83bf8267864101b49e4994b7ba8963/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.509320 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff29a16144094ac48b367879e8acb7a4, user_id=2e83bf8267864101b49e4994b7ba8963, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.511926 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.524643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1332/2683] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:26 2022] PUT /identity/v3/projects/ff29a16144094ac48b367879e8acb7a4/users/2e83bf8267864101b49e4994b7ba8963/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:26.534683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5befa-d181-46e4-aeda-b32aa7b93de9 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.535085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5befa-d181-46e4-aeda-b32aa7b93de9 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.535238 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5befa-d181-46e4-aeda-b32aa7b93de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.563221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-84f5befa-d181-46e4-aeda-b32aa7b93de9 None None] MFA Rules not processed for user `2e83bf8267864101b49e4994b7ba8963`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:26.564474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-84f5befa-d181-46e4-aeda-b32aa7b93de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:26.580342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:26.631917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1352/2684] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:26.636413 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.665133 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:26.699205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdcf23-7429-4b3c-bf59-86d83ec5d4a2 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.703812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.704443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.704736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.705007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.705642 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.707543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.732842 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1333/2685] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:26 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:26.736875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5befa-d181-46e4-aeda-b32aa7b93de9 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.747998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5befa-d181-46e4-aeda-b32aa7b93de9 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.924503 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.925029 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.925310 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.925587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.926207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.928097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.948436 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1353/2686] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:26 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:26.952498 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.962521 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2029-5dfd-4700-b513-c962e81f4ffa admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:26.967408 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:26.968024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:26.968321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:26.968599 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:26.969245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:26.970817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:26.981916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1334/2687] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:26.985757 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:26.995354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6764e4c-762a-4f23-8ca8-09a1b8871022 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:27.000163 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:27.000855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:27.001129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:27.001398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] PATH_INFO: `/v3/projects/0cd377ec54fc432fa2d5d57355fb26b8/users/cd36a28f0201421a8656f097061c9673/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:27.015373 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd377ec54fc432fa2d5d57355fb26b8, user_id=cd36a28f0201421a8656f097061c9673, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:27.018031 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:27.032893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1354/2688] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:26 2022] PUT /identity/v3/projects/0cd377ec54fc432fa2d5d57355fb26b8/users/cd36a28f0201421a8656f097061c9673/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:27.037173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:27.048007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77491-02d5-4e1d-b325-fdc9404097bb admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:27.101935 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6c35b-7c91-4456-87d4-769cf7e7ad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:27.102555 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c35b-7c91-4456-87d4-769cf7e7ad4f admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:27.102820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c35b-7c91-4456-87d4-769cf7e7ad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:27.103087 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c35b-7c91-4456-87d4-769cf7e7ad4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:27.103744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c35b-7c91-4456-87d4-769cf7e7ad4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:27.105986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c35b-7c91-4456-87d4-769cf7e7ad4f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:27.115560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1335/2689] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:27.119707 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:27.129987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0845ecc-ea4f-4723-bb51-7945043707d4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:27.134492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:27.135119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:27.135393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:27.135659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] PATH_INFO: `/v3/projects/0cd377ec54fc432fa2d5d57355fb26b8/users/cd36a28f0201421a8656f097061c9673/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:27.138065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd377ec54fc432fa2d5d57355fb26b8, user_id=cd36a28f0201421a8656f097061c9673, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:27.140687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:27.150482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1355/2690] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:27 2022] PUT /identity/v3/projects/0cd377ec54fc432fa2d5d57355fb26b8/users/cd36a28f0201421a8656f097061c9673/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:27.161260 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0983e2-3b3b-4abb-b9ca-354632d7fd22 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:27.161550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0983e2-3b3b-4abb-b9ca-354632d7fd22 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:27.161909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0983e2-3b3b-4abb-b9ca-354632d7fd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:27.188931 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4e0983e2-3b3b-4abb-b9ca-354632d7fd22 None None] MFA Rules not processed for user `cd36a28f0201421a8656f097061c9673`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:27.190051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4e0983e2-3b3b-4abb-b9ca-354632d7fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:27.255720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1336/2691] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:27.266878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:27.268685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:27.324566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96276b-2149-44a8-a241-cdaed9d3a9b9 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:27.328203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ea383-3d4d-4151-9892-06c6c9692236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:27.328840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ea383-3d4d-4151-9892-06c6c9692236 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:27.329120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ea383-3d4d-4151-9892-06c6c9692236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:27.329393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ea383-3d4d-4151-9892-06c6c9692236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:27.354075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:27.386468 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ea383-3d4d-4151-9892-06c6c9692236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:27.388448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ea383-3d4d-4151-9892-06c6c9692236 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:27.397115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1356/2692] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:29.926971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0983e2-3b3b-4abb-b9ca-354632d7fd22 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:29.951073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:29.988714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0983e2-3b3b-4abb-b9ca-354632d7fd22 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:29.993153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:29.993775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:29.994051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:29.994323 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] PATH_INFO: `/v3/users/2e83bf8267864101b49e4994b7ba8963` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:29.995423 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e83bf8267864101b49e4994b7ba8963)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:29.997392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:30.042698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e83bf8267864101b49e4994b7ba8963'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.050432 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e83bf8267864101b49e4994b7ba8963'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.051061 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e83bf8267864101b49e4994b7ba8963'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.063033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e83bf8267864101b49e4994b7ba8963'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.069800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e83bf8267864101b49e4994b7ba8963'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.075573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1337/2693] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:29 2022] DELETE /identity/v3/users/2e83bf8267864101b49e4994b7ba8963 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:30.080084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:30.080616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:30.080718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:30.099400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:30.100619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:30.162835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1357/2694] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:30.172870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:30.174290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:30.229683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60931a-8794-47eb-b359-727d335a047a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:30.233310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:30.233907 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:30.234186 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:30.234459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:30.243306 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:30.244757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:30.254049 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1338/2695] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:30.529621 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:30.534409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:30.548737 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346cafa-8150-4495-9a48-31704f01f009 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:30.553269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:30.553900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:30.554177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:30.554452 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] PATH_INFO: `/v3/projects/ff29a16144094ac48b367879e8acb7a4` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:30.555564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff29a16144094ac48b367879e8acb7a4)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:30.557504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:30.603524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff29a16144094ac48b367879e8acb7a4', 'request_id': 'req-ae2459d3-acb6-4cd4-b547-1c4d42363499'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.611711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff29a16144094ac48b367879e8acb7a4', 'request_id': 'req-ae2459d3-acb6-4cd4-b547-1c4d42363499'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.617181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff29a16144094ac48b367879e8acb7a4', 'request_id': 'req-ae2459d3-acb6-4cd4-b547-1c4d42363499'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.628829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] The token cache is being invalidate because project ff29a16144094ac48b367879e8acb7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:30.629120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.629768 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.631216 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1358/2696] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:30 2022] DELETE /identity/v3/projects/ff29a16144094ac48b367879e8acb7a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:30.635343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:30.645276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b540-1968-458b-b1cd-969bfc9d46f0 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:30.686171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:30.702784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:30.703343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:30.703624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:30.703897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] PATH_INFO: `/v3/users/cd36a28f0201421a8656f097061c9673` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:30.705028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd36a28f0201421a8656f097061c9673)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:30.706925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:30.750545 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd36a28f0201421a8656f097061c9673'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.757346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd36a28f0201421a8656f097061c9673'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.758108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd36a28f0201421a8656f097061c9673'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.770315 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd36a28f0201421a8656f097061c9673'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.776992 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-92b3ecdb-7441-4599-9ebd-f176401d212a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd36a28f0201421a8656f097061c9673'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:30.782925 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1339/2697] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:30 2022] DELETE /identity/v3/users/cd36a28f0201421a8656f097061c9673 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:31.049559 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.051024 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:31.064695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2459d3-acb6-4cd4-b547-1c4d42363499 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.110798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:31.125094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.125736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.126016 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.126287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] PATH_INFO: `/v3/projects/0cd377ec54fc432fa2d5d57355fb26b8` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.127427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd377ec54fc432fa2d5d57355fb26b8)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.129370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.174259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd377ec54fc432fa2d5d57355fb26b8', 'request_id': 'req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:31.181552 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd377ec54fc432fa2d5d57355fb26b8', 'request_id': 'req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:31.187648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd377ec54fc432fa2d5d57355fb26b8', 'request_id': 'req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:31.200329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] The token cache is being invalidate because project 0cd377ec54fc432fa2d5d57355fb26b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:31.200564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:31.201306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c3ab2c09-e9d3-4316-ad73-4ca75c8695c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:31.203091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1359/2698] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:31 2022] DELETE /identity/v3/projects/0cd377ec54fc432fa2d5d57355fb26b8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:31.207718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d386c-8aad-4f27-aaba-6358b81e2954 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.208172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d386c-8aad-4f27-aaba-6358b81e2954 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.208328 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d386c-8aad-4f27-aaba-6358b81e2954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.227489 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d70d386c-8aad-4f27-aaba-6358b81e2954 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:31.228638 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d70d386c-8aad-4f27-aaba-6358b81e2954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:31.286205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1340/2699] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:31.295500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f94f-bc59-43b9-924e-552f9da8322e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.295776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f94f-bc59-43b9-924e-552f9da8322e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.296042 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f94f-bc59-43b9-924e-552f9da8322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.315911 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d3f8f94f-bc59-43b9-924e-552f9da8322e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:31.317121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d3f8f94f-bc59-43b9-924e-552f9da8322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:31.324933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1360/2700] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:31.329218 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d386c-8aad-4f27-aaba-6358b81e2954 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.338612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d386c-8aad-4f27-aaba-6358b81e2954 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.343624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.344207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.344514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.344782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.345414 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:31.345713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.347281 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.358857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1341/2701] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:31.362780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f94f-bc59-43b9-924e-552f9da8322e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.371627 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f94f-bc59-43b9-924e-552f9da8322e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.376459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.377041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.377319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.377585 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.378197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.380081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.406629 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1361/2702] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:31 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:31.410706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.421374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6c2ef-ae37-4b47-a3f1-cc0478774651 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.466013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:31.477159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.477818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.478048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.478325 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.478962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.481559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.502304 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1342/2703] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:31 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:31.506418 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.516886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4671e94-bd96-4fac-b289-329ad0f62d36 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.522246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.522840 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.523115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.523382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.524046 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.525725 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.541909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1362/2704] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:31.543725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.553984 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e04e7-3d94-4b12-8539-b91a4f746050 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.558942 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c2e9-6945-4b73-9e76-c02af00704f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.559618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c2e9-6945-4b73-9e76-c02af00704f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.560076 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c2e9-6945-4b73-9e76-c02af00704f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.560450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c2e9-6945-4b73-9e76-c02af00704f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.561240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c2e9-6945-4b73-9e76-c02af00704f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.563036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c2e9-6945-4b73-9e76-c02af00704f8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.573895 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1343/2705] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:31.578117 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.588311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7f84-90f8-4cb6-bd29-590d262449c8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.593652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.594323 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.594603 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.594876 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] PATH_INFO: `/v3/projects/6424b2651ba24809b747eb2ae49625cb/users/a4d63df1b7a14a64a94ec5e6484e0303/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.610530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6424b2651ba24809b747eb2ae49625cb, user_id=a4d63df1b7a14a64a94ec5e6484e0303, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.613241 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.625678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1363/2706] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:31 2022] PUT /identity/v3/projects/6424b2651ba24809b747eb2ae49625cb/users/a4d63df1b7a14a64a94ec5e6484e0303/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:31.635811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66125db-e94e-4b89-aad2-5d75804643b0 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.636101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66125db-e94e-4b89-aad2-5d75804643b0 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.636918 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66125db-e94e-4b89-aad2-5d75804643b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.664653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-a66125db-e94e-4b89-aad2-5d75804643b0 None None] MFA Rules not processed for user `a4d63df1b7a14a64a94ec5e6484e0303`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:31.665863 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a66125db-e94e-4b89-aad2-5d75804643b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:31.729359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1344/2707] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:31.740070 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:31.741802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:31.797194 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803294d4-2ca8-461e-bae9-013c67b8c7e5 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:31.802249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8399-1560-4111-8f0f-3807a509199f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:31.803096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8399-1560-4111-8f0f-3807a509199f service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:31.803371 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8399-1560-4111-8f0f-3807a509199f service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:31.803638 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8399-1560-4111-8f0f-3807a509199f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:31.813361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8399-1560-4111-8f0f-3807a509199f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:31.814970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8399-1560-4111-8f0f-3807a509199f service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:31.826339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1364/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:34.851649 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66125db-e94e-4b89-aad2-5d75804643b0 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:34.913091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66125db-e94e-4b89-aad2-5d75804643b0 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:34.917620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:34.918243 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:34.918522 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:34.918800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] PATH_INFO: `/v3/users/a4d63df1b7a14a64a94ec5e6484e0303` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:34.919929 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d63df1b7a14a64a94ec5e6484e0303)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:34.921859 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:34.968176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d63df1b7a14a64a94ec5e6484e0303'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:34.975515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d63df1b7a14a64a94ec5e6484e0303'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:34.976350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d63df1b7a14a64a94ec5e6484e0303'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:34.981718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:34.990361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d63df1b7a14a64a94ec5e6484e0303'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:34.997917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d63df1b7a14a64a94ec5e6484e0303'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:35.004571 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1345/2709] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:34 2022] DELETE /identity/v3/users/a4d63df1b7a14a64a94ec5e6484e0303 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:35.010385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.010873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.010985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.030916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:35.032177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:35.044222 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:35.092771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1365/2710] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:35.103592 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.105029 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:35.170280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014f831-8e3b-44ba-9b9f-2c35c3029511 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.174713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dec984-33c4-46fe-9bc9-1e28a895865a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.175410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec984-33c4-46fe-9bc9-1e28a895865a service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.176346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec984-33c4-46fe-9bc9-1e28a895865a service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.176632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec984-33c4-46fe-9bc9-1e28a895865a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.188500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dec984-33c4-46fe-9bc9-1e28a895865a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.189977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dec984-33c4-46fe-9bc9-1e28a895865a service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:35.200097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1346/2711] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:37:35.484925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.486463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:35.499687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3380-b33d-47e8-af93-0f4b925fd3ae None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.504344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.504971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.505276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.505543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] PATH_INFO: `/v3/projects/6424b2651ba24809b747eb2ae49625cb` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.506664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6424b2651ba24809b747eb2ae49625cb)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.508612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:35.555928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6424b2651ba24809b747eb2ae49625cb', 'request_id': 'req-67ad2bdd-1438-4db5-8632-313a713ac89e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:35.565099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6424b2651ba24809b747eb2ae49625cb', 'request_id': 'req-67ad2bdd-1438-4db5-8632-313a713ac89e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:35.570734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6424b2651ba24809b747eb2ae49625cb', 'request_id': 'req-67ad2bdd-1438-4db5-8632-313a713ac89e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:35.581753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] The token cache is being invalidate because project 6424b2651ba24809b747eb2ae49625cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:35.582048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:35.582688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-67ad2bdd-1438-4db5-8632-313a713ac89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:35.584151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1366/2712] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:35 2022] DELETE /identity/v3/projects/6424b2651ba24809b747eb2ae49625cb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:35.589075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579148-9eb9-4905-a8a7-6d54a7bf790c None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.591262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579148-9eb9-4905-a8a7-6d54a7bf790c None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.591262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579148-9eb9-4905-a8a7-6d54a7bf790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.609019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b6579148-9eb9-4905-a8a7-6d54a7bf790c None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:35.610130 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b6579148-9eb9-4905-a8a7-6d54a7bf790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:35.670159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1347/2713] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:35.679040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c700-2578-400d-86cc-94d9f20a0611 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.679448 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c700-2578-400d-86cc-94d9f20a0611 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.679828 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c700-2578-400d-86cc-94d9f20a0611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.700293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-e318c700-2578-400d-86cc-94d9f20a0611 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:35.701482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-e318c700-2578-400d-86cc-94d9f20a0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:35.709445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1367/2714] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:35.713688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579148-9eb9-4905-a8a7-6d54a7bf790c None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.724766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579148-9eb9-4905-a8a7-6d54a7bf790c None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.729337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.730475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.730737 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.731015 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.731656 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:35.731960 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.733600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:35.744959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1348/2715] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:35.749839 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318c700-2578-400d-86cc-94d9f20a0611 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.758781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318c700-2578-400d-86cc-94d9f20a0611 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.763325 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.763910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.764185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.764485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.765107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.766965 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:35.794256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1368/2716] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:35 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:35.798302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.808068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1127-37ca-4013-9746-d5f7972fcdf7 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.863452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.864062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.864372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.864648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.865274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.867187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:35.884005 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:35.890646 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1349/2717] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:35 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:35.895140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.906009 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673fb4e-6e38-447f-b34f-3338248c7c2f admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.910608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.911200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.911479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.911749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.912420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.914002 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:35.924469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1369/2718] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:35.929487 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.939416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f16cc8-2b93-433a-9c16-5667d77a4742 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.943913 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929fffa-ad09-4109-a54d-8f5c4bf86c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.944529 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fffa-ad09-4109-a54d-8f5c4bf86c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.944806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fffa-ad09-4109-a54d-8f5c4bf86c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.945075 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fffa-ad09-4109-a54d-8f5c4bf86c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.945703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929fffa-ad09-4109-a54d-8f5c4bf86c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.947268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929fffa-ad09-4109-a54d-8f5c4bf86c5b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:35.957461 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1350/2719] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:37:35.961358 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:35.971555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecc29f-dd41-4354-932d-108e9441a0cf admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:35.976711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:35.977356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:35.977634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:35.977909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] PATH_INFO: `/v3/projects/c9c1a84a690345909add6cd427640a21/users/7365161e16414880be7b9c8735c693ae/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:35.993847 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c1a84a690345909add6cd427640a21, user_id=7365161e16414880be7b9c8735c693ae, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:35.996563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.009294 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1370/2720] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:35 2022] PUT /identity/v3/projects/c9c1a84a690345909add6cd427640a21/users/7365161e16414880be7b9c8735c693ae/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:37:36.019538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b7b6c-901a-46fa-b8bf-baac043e7b17 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.019877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b7b6c-901a-46fa-b8bf-baac043e7b17 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.020231 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b7b6c-901a-46fa-b8bf-baac043e7b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.048531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-f66b7b6c-901a-46fa-b8bf-baac043e7b17 None None] MFA Rules not processed for user `7365161e16414880be7b9c8735c693ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:36.049742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f66b7b6c-901a-46fa-b8bf-baac043e7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:36.112116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1351/2721] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:36.116542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.156660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:36.177718 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74555a7-adcc-47d3-bcdb-d5ed3dd799cc admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.182425 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.183018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.183318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.183584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.184197 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.186103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.212037 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1371/2722] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:36 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:36.216789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b7b6c-901a-46fa-b8bf-baac043e7b17 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.227471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b7b6c-901a-46fa-b8bf-baac043e7b17 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.281772 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.282377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.282661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.282938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.283556 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.285519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.305674 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1352/2723] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:36 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:36.309745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.319859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d1b9f-5c1a-4630-bf86-27672e98361e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.325140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.325734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.326012 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.326281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.326960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.328496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.338981 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1372/2724] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:36.343626 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.353791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3a8e-e740-4734-b5c0-d9fd4f4d8974 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.358488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf976c-cc84-40eb-9f73-09a12695bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.359081 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf976c-cc84-40eb-9f73-09a12695bf84 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.359357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf976c-cc84-40eb-9f73-09a12695bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.359624 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf976c-cc84-40eb-9f73-09a12695bf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.360467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf976c-cc84-40eb-9f73-09a12695bf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.362059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf976c-cc84-40eb-9f73-09a12695bf84 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.372508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1353/2725] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:36.376819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.387416 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed27c-8085-4c2c-86bf-8732a01c1a91 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.391998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.392696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.392963 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.393247 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] PATH_INFO: `/v3/projects/ac68059076544641a93add84ff6eeb3b/users/fa37d9583ebe440da794144a82e151bc/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.409608 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac68059076544641a93add84ff6eeb3b, user_id=fa37d9583ebe440da794144a82e151bc, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.412246 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.425678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1373/2726] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:36 2022] PUT /identity/v3/projects/ac68059076544641a93add84ff6eeb3b/users/fa37d9583ebe440da794144a82e151bc/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:36.435815 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9b39-6771-4fc9-87f7-336d420d20dc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.436187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9b39-6771-4fc9-87f7-336d420d20dc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.436570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9b39-6771-4fc9-87f7-336d420d20dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.466888 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-4bdf9b39-6771-4fc9-87f7-336d420d20dc None None] MFA Rules not processed for user `fa37d9583ebe440da794144a82e151bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:36.468188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-4bdf9b39-6771-4fc9-87f7-336d420d20dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:36.514018 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:36.545911 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1354/2727] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:36.547103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.615824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7866f4-3c7a-4577-80d6-337454f33d0e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.620248 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.621375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.621649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.621917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.622548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.624721 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.650883 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1374/2728] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:36 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:37:36.655007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9b39-6771-4fc9-87f7-336d420d20dc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.665401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9b39-6771-4fc9-87f7-336d420d20dc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.721099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.721701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.721977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.722250 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.722875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.724822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.746221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1355/2729] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:36 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:36.751099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.761921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eab2d-c5ba-4d76-94ec-79fd57765cb6 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.766398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.766988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.767264 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.767533 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.768169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.769776 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.779874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1375/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:36.783830 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.793490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd412-aafc-4af5-a8fd-3f5e45670a97 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.798012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.798681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.798958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.799236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] PATH_INFO: `/v3/projects/c2d9d8cb9f6f41f5a6094e6ff31f2369/users/4185bfedcc05426fb0df1b545bc3f5fa/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.814194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d9d8cb9f6f41f5a6094e6ff31f2369, user_id=4185bfedcc05426fb0df1b545bc3f5fa, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.816903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.830185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1356/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:36 2022] PUT /identity/v3/projects/c2d9d8cb9f6f41f5a6094e6ff31f2369/users/4185bfedcc05426fb0df1b545bc3f5fa/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:36.834453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.844433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae599-dd00-4677-bd8c-0b9ad2f9a341 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.902067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12b7da-49a0-4940-9a33-42febf6527cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.902626 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12b7da-49a0-4940-9a33-42febf6527cd admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.902917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12b7da-49a0-4940-9a33-42febf6527cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.903208 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12b7da-49a0-4940-9a33-42febf6527cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.903864 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12b7da-49a0-4940-9a33-42febf6527cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.905467 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12b7da-49a0-4940-9a33-42febf6527cd admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.907469 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:36.920779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1376/2732] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:36.921950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:36.931946 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0f23f-8438-4073-b45c-e8a63dd45057 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:36.937246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:36.937896 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.938174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.938444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] PATH_INFO: `/v3/projects/c2d9d8cb9f6f41f5a6094e6ff31f2369/users/4185bfedcc05426fb0df1b545bc3f5fa/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.940397 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d9d8cb9f6f41f5a6094e6ff31f2369, user_id=4185bfedcc05426fb0df1b545bc3f5fa, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:36.943132 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:36.954024 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1357/2733] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:36 2022] PUT /identity/v3/projects/c2d9d8cb9f6f41f5a6094e6ff31f2369/users/4185bfedcc05426fb0df1b545bc3f5fa/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:36.965026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec3e9-5fbc-43fe-ad28-e99207e0d681 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:36.965333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec3e9-5fbc-43fe-ad28-e99207e0d681 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:36.965613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec3e9-5fbc-43fe-ad28-e99207e0d681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:36.992948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1d8ec3e9-5fbc-43fe-ad28-e99207e0d681 None None] MFA Rules not processed for user `4185bfedcc05426fb0df1b545bc3f5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:36.994136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1d8ec3e9-5fbc-43fe-ad28-e99207e0d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:37.063900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1377/2734] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:37.075541 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:37.077238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:37.134028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5249c71-b0d5-479f-8e04-e3162bbea945 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:37.137622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:37.138232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:37.138503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:37.138777 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:37.185510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:37.194979 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:37.196431 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:37.205409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1358/2735] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:38.696105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ec3e9-5fbc-43fe-ad28-e99207e0d681 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:38.705921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ec3e9-5fbc-43fe-ad28-e99207e0d681 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:38.709339 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:38.709930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:38.710206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:38.710477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:38.767331 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:38.768873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:38.777555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1378/2736] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:39.309714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:39.318194 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d309-1add-4507-bbbd-416259089e4f service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:39.321755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055bbbf-848a-4812-a712-b60f97d828c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:39.322374 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055bbbf-848a-4812-a712-b60f97d828c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:39.322657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055bbbf-848a-4812-a712-b60f97d828c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:39.322933 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055bbbf-848a-4812-a712-b60f97d828c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:39.332259 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055bbbf-848a-4812-a712-b60f97d828c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:39.333708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055bbbf-848a-4812-a712-b60f97d828c5 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:39.343013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1359/2737] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:42.223647 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:42.225225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:42.294091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356eeb-f7b6-4fba-8af3-2bb9c3c62b2c service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:42.298423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:42.299042 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:42.299318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:42.299589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] PATH_INFO: `/v3/users/2606f8015fcc4c19a7b51492bc453829` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:42.300742 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2606f8015fcc4c19a7b51492bc453829)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:42.302622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:42.324120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:42.347890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2606f8015fcc4c19a7b51492bc453829'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.355143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2606f8015fcc4c19a7b51492bc453829'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.355715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2606f8015fcc4c19a7b51492bc453829'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.362921 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2606f8015fcc4c19a7b51492bc453829'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.374401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2606f8015fcc4c19a7b51492bc453829'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.380089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1379/2738] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:42 2022] DELETE /identity/v3/users/2606f8015fcc4c19a7b51492bc453829 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:42.384682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:42.385135 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:42.385280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:42.404774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:42.405954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:42.461816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1360/2739] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:42.471909 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:42.473314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:42.529584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c5f5-7eb4-40dd-9027-2332de2d9c13 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:42.533233 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f12b-b6b1-43a8-b6e7-ca731e53543e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:42.533884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f12b-b6b1-43a8-b6e7-ca731e53543e service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:42.534161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f12b-b6b1-43a8-b6e7-ca731e53543e service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:42.534431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f12b-b6b1-43a8-b6e7-ca731e53543e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:42.543114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f12b-b6b1-43a8-b6e7-ca731e53543e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:42.544609 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f12b-b6b1-43a8-b6e7-ca731e53543e service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:42.553774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1380/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:42.812846 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:42.814389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:42.827165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a64672-f3bb-47bd-8123-f789849262a8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:42.832229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:42.832910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:42.833189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:42.833463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] PATH_INFO: `/v3/projects/bd490bbbcd704e2bb2caf8f2a31d84a6` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:42.834581 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd490bbbcd704e2bb2caf8f2a31d84a6)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:42.836513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:42.885584 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd490bbbcd704e2bb2caf8f2a31d84a6', 'request_id': 'req-65db88f2-7816-46aa-9898-ac8351c8c325'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.891101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd490bbbcd704e2bb2caf8f2a31d84a6', 'request_id': 'req-65db88f2-7816-46aa-9898-ac8351c8c325'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.897467 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd490bbbcd704e2bb2caf8f2a31d84a6', 'request_id': 'req-65db88f2-7816-46aa-9898-ac8351c8c325'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.910102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] The token cache is being invalidate because project bd490bbbcd704e2bb2caf8f2a31d84a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:42.910377 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.911023 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65db88f2-7816-46aa-9898-ac8351c8c325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:42.912537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1361/2741] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:42 2022] DELETE /identity/v3/projects/bd490bbbcd704e2bb2caf8f2a31d84a6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:42.917394 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abd12f-0c72-4e65-926b-0e19af585c51 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:42.917684 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abd12f-0c72-4e65-926b-0e19af585c51 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:42.917962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abd12f-0c72-4e65-926b-0e19af585c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:42.937805 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-01abd12f-0c72-4e65-926b-0e19af585c51 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:42.938990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-01abd12f-0c72-4e65-926b-0e19af585c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:42.995254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1381/2742] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:43.004021 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1241-edd4-4cab-96b2-1ca205ad7e20 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.004337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1241-edd4-4cab-96b2-1ca205ad7e20 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.004617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1241-edd4-4cab-96b2-1ca205ad7e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.023882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-eada1241-edd4-4cab-96b2-1ca205ad7e20 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:43.025103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-eada1241-edd4-4cab-96b2-1ca205ad7e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.032818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1362/2743] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:43.036983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abd12f-0c72-4e65-926b-0e19af585c51 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.047507 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abd12f-0c72-4e65-926b-0e19af585c51 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.052027 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.052658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.052943 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.053214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.053857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:43.054158 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.055786 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.067619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1382/2744] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:43.071683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1241-edd4-4cab-96b2-1ca205ad7e20 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.080583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1241-edd4-4cab-96b2-1ca205ad7e20 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.085119 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.085702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.085977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.086268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.086880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.088785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.114951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1363/2745] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:43 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:43.118982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.129583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c904a2-db89-4d6b-81f9-52a5337c5458 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.159597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:43.192640 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.193250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.193530 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.193802 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.194438 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.196367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.207920 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.210311 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.218462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1383/2746] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:43 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:43.222140 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.226123 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd219f9-70a4-442f-a491-7547e7ea5cfe admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.232396 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.232797 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8393d-d844-4588-b0d7-d9fc264d9f0e admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.233313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.233411 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.233616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] PATH_INFO: `/v3/users/7365161e16414880be7b9c8735c693ae` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.234785 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7365161e16414880be7b9c8735c693ae)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.236812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.237317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.237894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.238162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.238427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.239053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.240643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.251497 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1384/2747] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:37:43.255535 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.268522 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62936fcb-f411-424f-917c-b61a008e6af4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.269527 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:43.276808 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.278622 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.279242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.279855 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.280856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.283364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.290000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7365161e16414880be7b9c8735c693ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:43.295688 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1385/2748] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 05:37:43.298614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7365161e16414880be7b9c8735c693ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:43.299385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7365161e16414880be7b9c8735c693ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:43.300510 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.302316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.312082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7365161e16414880be7b9c8735c693ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:43.314971 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792928f-06e9-4e65-9b12-eb6b155e5c68 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.318852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a0e51293-84e7-41b4-b18a-01080b2669ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7365161e16414880be7b9c8735c693ae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:43.319653 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e9129-4965-4c8c-8b47-1a617dd8b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.320514 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9129-4965-4c8c-8b47-1a617dd8b104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.321085 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9129-4965-4c8c-8b47-1a617dd8b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.321374 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9129-4965-4c8c-8b47-1a617dd8b104 admin admin] PATH_INFO: `/v3/projects/60f64523e46844c59a817d3d5b69361e/users/7f0be2b3fa404e69890ed0ba58515c8d/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.325146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1364/2749] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:43 2022] DELETE /identity/v3/users/7365161e16414880be7b9c8735c693ae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:37:43.329280 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.329596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.330036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.336763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e9129-4965-4c8c-8b47-1a617dd8b104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f64523e46844c59a817d3d5b69361e, user_id=7f0be2b3fa404e69890ed0ba58515c8d, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.339500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e9129-4965-4c8c-8b47-1a617dd8b104 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.352850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:43.353345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1386/2750] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:43 2022] PUT /identity/v3/projects/60f64523e46844c59a817d3d5b69361e/users/7f0be2b3fa404e69890ed0ba58515c8d/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:43.354082 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.358875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.359166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.359434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.377946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:43.379122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.414000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1365/2751] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:43.424313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.425665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.437915 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1387/2752] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:43.447221 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.448643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.485802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21ba57-3a9c-455d-a697-a9a292c4d1f3 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.489428 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.490319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.490319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.490575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.499838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.501362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.505631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e41fe-f5eb-42c0-bd38-0487a8af9edc None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.509224 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.509816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.510090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.510354 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.510965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1366/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:37:43.519710 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.521169 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.531098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1388/2754] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:37:43.887361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:43.889349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:43.902726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56993d-2ee9-4fdb-9842-1fcc78f96013 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:43.907448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:43.908155 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:43.908523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:43.908804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] PATH_INFO: `/v3/projects/c9c1a84a690345909add6cd427640a21` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:43.909997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c1a84a690345909add6cd427640a21)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:43.912153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:43.966980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:43.972035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c1a84a690345909add6cd427640a21', 'request_id': 'req-af34f3e5-0473-4b4f-8dd6-316340d0fc25'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:43.979536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c1a84a690345909add6cd427640a21', 'request_id': 'req-af34f3e5-0473-4b4f-8dd6-316340d0fc25'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:43.987770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c1a84a690345909add6cd427640a21', 'request_id': 'req-af34f3e5-0473-4b4f-8dd6-316340d0fc25'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.005121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] The token cache is being invalidate because project c9c1a84a690345909add6cd427640a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:44.006198 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.006847 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.008579 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1367/2755] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:43 2022] DELETE /identity/v3/projects/c9c1a84a690345909add6cd427640a21 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:37:44.012540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:44.024671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4dfa9-126a-402d-a68e-3b014da3d31b service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:44.037722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:44.093676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:44.094316 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:44.094598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:44.094906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] PATH_INFO: `/v3/users/fa37d9583ebe440da794144a82e151bc` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:44.096038 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa37d9583ebe440da794144a82e151bc)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:44.097999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:44.152189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa37d9583ebe440da794144a82e151bc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.161873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa37d9583ebe440da794144a82e151bc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.162555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa37d9583ebe440da794144a82e151bc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.173268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa37d9583ebe440da794144a82e151bc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.189645 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa37d9583ebe440da794144a82e151bc'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.195869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1389/2756] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:44 2022] DELETE /identity/v3/users/fa37d9583ebe440da794144a82e151bc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:44.542199 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:44.544254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:44.562540 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34f3e5-0473-4b4f-8dd6-316340d0fc25 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:44.628851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:44.629982 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:44.630103 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:44.630297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] PATH_INFO: `/v3/projects/ac68059076544641a93add84ff6eeb3b` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:44.631902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac68059076544641a93add84ff6eeb3b)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:44.633928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:44.686882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac68059076544641a93add84ff6eeb3b', 'request_id': 'req-d37ac233-adc3-4691-bbf2-a07e38609f21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.693140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac68059076544641a93add84ff6eeb3b', 'request_id': 'req-d37ac233-adc3-4691-bbf2-a07e38609f21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.700743 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac68059076544641a93add84ff6eeb3b', 'request_id': 'req-d37ac233-adc3-4691-bbf2-a07e38609f21'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.715368 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] The token cache is being invalidate because project ac68059076544641a93add84ff6eeb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:44.716381 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.717053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.718559 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1368/2757] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:44 2022] DELETE /identity/v3/projects/ac68059076544641a93add84ff6eeb3b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:44.722687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:44.724551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:44.739232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3339fe-300d-45cc-b2f0-a648ee00ac37 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:44.803607 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:44.804476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:44.804932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:44.805254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] PATH_INFO: `/v3/users/4185bfedcc05426fb0df1b545bc3f5fa` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:44.806784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4185bfedcc05426fb0df1b545bc3f5fa)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:44.808875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:44.874114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:44.885314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4185bfedcc05426fb0df1b545bc3f5fa'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.893485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4185bfedcc05426fb0df1b545bc3f5fa'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.894191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4185bfedcc05426fb0df1b545bc3f5fa'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.902146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4185bfedcc05426fb0df1b545bc3f5fa'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.924259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-bfda9cea-4def-4f44-874d-9005f3b1f819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4185bfedcc05426fb0df1b545bc3f5fa'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:44.930619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1390/2758] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:37:44 2022] DELETE /identity/v3/users/4185bfedcc05426fb0df1b545bc3f5fa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:45.317070 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:45.318833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:45.332981 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ac233-adc3-4691-bbf2-a07e38609f21 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:45.411808 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:45.412994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.413346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.413849 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] PATH_INFO: `/v3/projects/c2d9d8cb9f6f41f5a6094e6ff31f2369` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.415221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d9d8cb9f6f41f5a6094e6ff31f2369)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:45.417288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:45.421007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:45.479180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d9d8cb9f6f41f5a6094e6ff31f2369', 'request_id': 'req-abde53bc-f1ce-4cb4-a910-90f4c3b42937'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:45.486208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d9d8cb9f6f41f5a6094e6ff31f2369', 'request_id': 'req-abde53bc-f1ce-4cb4-a910-90f4c3b42937'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:45.493730 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d9d8cb9f6f41f5a6094e6ff31f2369', 'request_id': 'req-abde53bc-f1ce-4cb4-a910-90f4c3b42937'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:45.509271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] The token cache is being invalidate because project c2d9d8cb9f6f41f5a6094e6ff31f2369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:37:45.509838 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:45.510562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-abde53bc-f1ce-4cb4-a910-90f4c3b42937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:37:45.512172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1369/2759] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:37:45 2022] DELETE /identity/v3/projects/c2d9d8cb9f6f41f5a6094e6ff31f2369 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:45.517018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba88af-22e4-466c-99a2-13306cb8bca7 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.517304 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba88af-22e4-466c-99a2-13306cb8bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.517569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba88af-22e4-466c-99a2-13306cb8bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.539211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0dba88af-22e4-466c-99a2-13306cb8bca7 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:45.540404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0dba88af-22e4-466c-99a2-13306cb8bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:45.608537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1391/2760] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:45.616229 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ea216-d19d-4fd7-b98a-39ab6d59658e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.616723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ea216-d19d-4fd7-b98a-39ab6d59658e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.616947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ea216-d19d-4fd7-b98a-39ab6d59658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.639660 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e74ea216-d19d-4fd7-b98a-39ab6d59658e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:45.640928 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e74ea216-d19d-4fd7-b98a-39ab6d59658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:45.652415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1370/2761] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:45.655268 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba88af-22e4-466c-99a2-13306cb8bca7 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:45.673128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba88af-22e4-466c-99a2-13306cb8bca7 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:45.680457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:45.681279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.681618 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.681988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.682764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:37:45.683073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:45.685050 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:45.697229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1392/2762] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:37:45.701820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ea216-d19d-4fd7-b98a-39ab6d59658e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:45.713958 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ea216-d19d-4fd7-b98a-39ab6d59658e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:45.719851 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:45.720630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.720978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.721321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.722038 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:45.724190 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:45.760372 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1371/2763] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:45 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:45.762736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:45.775081 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8874a-01de-4b83-9924-e48b7a99ec35 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:45.848129 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:45.848966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.849251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.849527 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.850166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:45.852096 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:45.881830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1393/2764] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:45 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:45.888113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:45.898715 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a646b-b08d-4d96-b0a1-52b338b705c1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:45.904165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:45.904754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.905036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.905308 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.905956 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:45.907569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:45.922053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1372/2765] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:45.926021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:45.937900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f49f2-d9d3-45f3-925d-2cce2a923898 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:45.943630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba06fd-bb4e-46e2-b651-f02aa214ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:45.944252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba06fd-bb4e-46e2-b651-f02aa214ef3f admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.944564 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba06fd-bb4e-46e2-b651-f02aa214ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.944830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba06fd-bb4e-46e2-b651-f02aa214ef3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.945483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba06fd-bb4e-46e2-b651-f02aa214ef3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:45.947078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba06fd-bb4e-46e2-b651-f02aa214ef3f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:45.960254 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1394/2766] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:45.964608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:45.975596 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b08132-bef9-40da-b465-435b81a66d98 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:45.980834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:45.981547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:45.981824 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:45.982154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] PATH_INFO: `/v3/projects/18b69438287047109f87b250ef397b6e/users/d9b8d77b8ca049a08993c6d7ea30d149/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:45.998949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b69438287047109f87b250ef397b6e, user_id=d9b8d77b8ca049a08993c6d7ea30d149, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:46.001675 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:46.022483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1373/2767] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:45 2022] PUT /identity/v3/projects/18b69438287047109f87b250ef397b6e/users/d9b8d77b8ca049a08993c6d7ea30d149/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:46.035195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96a96f-8f5d-4916-9f7f-0b1a1587b43d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:46.036021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96a96f-8f5d-4916-9f7f-0b1a1587b43d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:46.036685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96a96f-8f5d-4916-9f7f-0b1a1587b43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:46.077324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-5b96a96f-8f5d-4916-9f7f-0b1a1587b43d None None] MFA Rules not processed for user `d9b8d77b8ca049a08993c6d7ea30d149`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:46.079098 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-5b96a96f-8f5d-4916-9f7f-0b1a1587b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:46.093054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:46.167258 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1395/2768] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:46.175762 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:46.177775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:46.239713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8de41-ce0e-4720-9dbe-8c3f1d36752d admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:46.243869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:46.244746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:46.244746 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:46.245053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:46.254889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:46.256493 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:46.268477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1374/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:48.253849 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8f1d-3786-4b1e-9087-60dc65241f8f None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:48.254414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8f1d-3786-4b1e-9087-60dc65241f8f None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:48.254573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8f1d-3786-4b1e-9087-60dc65241f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:48.310048 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c3fc8f1d-3786-4b1e-9087-60dc65241f8f None None] MFA Rules not processed for user `7f0be2b3fa404e69890ed0ba58515c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:48.311654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c3fc8f1d-3786-4b1e-9087-60dc65241f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:48.401317 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1396/2770] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:37:48.406433 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:48.408145 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:48.453254 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:48.488343 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62df508-f83f-474d-80c4-88e649eb3dbd service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:48.492812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:48.493416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:48.493694 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:48.493965 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:48.494605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:48.496598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:48.526424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1375/2771] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:37:48 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:48.530815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc8f1d-3786-4b1e-9087-60dc65241f8f None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:48.542064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc8f1d-3786-4b1e-9087-60dc65241f8f None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:48.602782 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:48.603396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:48.603676 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:48.603950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:48.604631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:48.606577 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:48.633873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1397/2772] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:37:48 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:37:48.635080 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:48.646732 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e7701-5854-48ee-8058-fc38150668c3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:48.651412 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:48.652026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:48.652336 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:48.652618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:48.653519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:48.655126 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:48.669594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1376/2773] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:48.670835 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:48.683279 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d58b-76f1-4978-9d3f-702b90154eaa admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:48.688975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:48.689888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:48.690251 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:48.690651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] PATH_INFO: `/v3/projects/a3735b7136ed4a249454bfb6f8233b06/users/7ea30998804e43c096baf417da9ea158/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:48.707173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3735b7136ed4a249454bfb6f8233b06, user_id=7ea30998804e43c096baf417da9ea158, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:48.709891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:48.748188 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1398/2774] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:48 2022] PUT /identity/v3/projects/a3735b7136ed4a249454bfb6f8233b06/users/7ea30998804e43c096baf417da9ea158/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:48.752443 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:48.763476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867998d4-d92a-4530-b72b-7263736504fc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:48.836140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53b9e9-a625-47db-b23e-8d2f82f860c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:48.836793 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b9e9-a625-47db-b23e-8d2f82f860c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:48.837073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b9e9-a625-47db-b23e-8d2f82f860c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:48.837346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b9e9-a625-47db-b23e-8d2f82f860c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:48.837991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53b9e9-a625-47db-b23e-8d2f82f860c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:48.839595 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53b9e9-a625-47db-b23e-8d2f82f860c7 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:48.850813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1377/2775] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:37:48.857255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:48.870683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ca497-4e1e-4d47-b28a-a869baa7c554 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:48.876391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:48.877091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:48.877372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:48.877651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] PATH_INFO: `/v3/projects/a3735b7136ed4a249454bfb6f8233b06/users/7ea30998804e43c096baf417da9ea158/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:48.879593 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3735b7136ed4a249454bfb6f8233b06, user_id=7ea30998804e43c096baf417da9ea158, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:48.882293 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:48.884711 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:37:48.895788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1399/2776] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:37:48 2022] PUT /identity/v3/projects/a3735b7136ed4a249454bfb6f8233b06/users/7ea30998804e43c096baf417da9ea158/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:37:53.120821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a565a92-f087-440b-aaa3-adbcd9154d6a None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:53.121363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a565a92-f087-440b-aaa3-adbcd9154d6a None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:53.121363 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a565a92-f087-440b-aaa3-adbcd9154d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:53.150673 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-6a565a92-f087-440b-aaa3-adbcd9154d6a None None] MFA Rules not processed for user `7ea30998804e43c096baf417da9ea158`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:53.151873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-6a565a92-f087-440b-aaa3-adbcd9154d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:53.233932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1378/2777] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:37:53.240200 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:37:53.243442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:53.356897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49da2-9549-4669-a993-296dc2a3ae11 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:37:53.362650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:37:53.363361 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:53.363534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:53.363831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:53.426720 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:37:53.429086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:37:53.440848 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1400/2778] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:37:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:37:54.549819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:37:54.550617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:37:54.550617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:37:54.576071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] MFA Rules not processed for user `7f0be2b3fa404e69890ed0ba58515c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:37:54.595614 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:37:54.604977 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1379/2779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:37:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:38:03.436683 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:INSERT=1,keystone:SELECT=67 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:04.567688 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:16.982473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:16.983906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:17.039388 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c772-9551-480a-9cb4-e6bad60a54c1 service nova] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:17.043287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:17.044522 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:17.044813 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:17.045088 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:17.046816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:17.060299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:17.061787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:17.074528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1401/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:38:18.486679 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:18.488149 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:18.543058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8f42a-9142-4d47-899b-c1bc666780b4 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:18.546539 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2224dc-a6a1-47d2-9d61-66256f88b0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:18.547125 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2224dc-a6a1-47d2-9d61-66256f88b0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:18.547400 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2224dc-a6a1-47d2-9d61-66256f88b0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:18.547667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2224dc-a6a1-47d2-9d61-66256f88b0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:18.549347 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3d2224dc-a6a1-47d2-9d61-66256f88b0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:18.562609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2224dc-a6a1-47d2-9d61-66256f88b0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:18.564019 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2224dc-a6a1-47d2-9d61-66256f88b0b3 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:18.574479 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1380/2781] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:38:27.070505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=26 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:28.550277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:28.569706 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=26 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:28.611857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fe75e-983b-4efe-906a-1b04a794ab44 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:28.616203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:28.616854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:28.617128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:28.617398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] PATH_INFO: `/v3/users/d9b8d77b8ca049a08993c6d7ea30d149` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:28.618501 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b8d77b8ca049a08993c6d7ea30d149)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:28.620444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:28.664606 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b8d77b8ca049a08993c6d7ea30d149'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:28.672814 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b8d77b8ca049a08993c6d7ea30d149'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:28.673431 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b8d77b8ca049a08993c6d7ea30d149'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:28.680105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b8d77b8ca049a08993c6d7ea30d149'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:28.692231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b8d77b8ca049a08993c6d7ea30d149'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:28.697947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1402/2782] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:38:28 2022] DELETE /identity/v3/users/d9b8d77b8ca049a08993c6d7ea30d149 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:38:28.702542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e86af-c865-4afe-b66a-243def683136 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:28.702831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e86af-c865-4afe-b66a-243def683136 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:28.703109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e86af-c865-4afe-b66a-243def683136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:28.722012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-d46e86af-c865-4afe-b66a-243def683136 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:38:28.723237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d46e86af-c865-4afe-b66a-243def683136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:28.781108 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1381/2783] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:38:28.790756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:28.792139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:28.852686 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66201c8b-5bf6-42de-8b45-313180ba06a4 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:28.857121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae227b8-c9df-400d-aa35-1e9d0df19f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:28.857732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae227b8-c9df-400d-aa35-1e9d0df19f87 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:28.858014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae227b8-c9df-400d-aa35-1e9d0df19f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:28.858282 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae227b8-c9df-400d-aa35-1e9d0df19f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:28.867291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae227b8-c9df-400d-aa35-1e9d0df19f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:28.868750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae227b8-c9df-400d-aa35-1e9d0df19f87 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:28.878731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1403/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:38:29.467607 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e86af-c865-4afe-b66a-243def683136 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:29.469142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d46e86af-c865-4afe-b66a-243def683136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:29.480849 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e86af-c865-4afe-b66a-243def683136 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:29.485475 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:29.486253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.486603 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.486964 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] PATH_INFO: `/v3/projects/18b69438287047109f87b250ef397b6e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.488142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b69438287047109f87b250ef397b6e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:29.490101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:29.552450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b69438287047109f87b250ef397b6e', 'request_id': 'req-3b22f20d-de97-4fff-96d1-85ea28ed6534'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:29.558435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b69438287047109f87b250ef397b6e', 'request_id': 'req-3b22f20d-de97-4fff-96d1-85ea28ed6534'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:29.565004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b69438287047109f87b250ef397b6e', 'request_id': 'req-3b22f20d-de97-4fff-96d1-85ea28ed6534'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:29.578833 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] The token cache is being invalidate because project 18b69438287047109f87b250ef397b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:38:29.579501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:29.580010 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-3b22f20d-de97-4fff-96d1-85ea28ed6534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:29.581550 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1382/2785] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:38:29 2022] DELETE /identity/v3/projects/18b69438287047109f87b250ef397b6e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:38:29.586545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72525f1a-5feb-4f18-b05b-4c1cadf01f93 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.587008 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72525f1a-5feb-4f18-b05b-4c1cadf01f93 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.587130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72525f1a-5feb-4f18-b05b-4c1cadf01f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.607482 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-72525f1a-5feb-4f18-b05b-4c1cadf01f93 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:38:29.608703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-72525f1a-5feb-4f18-b05b-4c1cadf01f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:29.625406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:29.687311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1404/2786] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:38:29.695095 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ed87-32b1-4e98-8680-6481e52a1857 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.695447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ed87-32b1-4e98-8680-6481e52a1857 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.696491 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ed87-32b1-4e98-8680-6481e52a1857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.717999 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9828ed87-32b1-4e98-8680-6481e52a1857 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:38:29.719275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9828ed87-32b1-4e98-8680-6481e52a1857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:29.727143 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1383/2787] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:38:29.731562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72525f1a-5feb-4f18-b05b-4c1cadf01f93 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:29.740986 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72525f1a-5feb-4f18-b05b-4c1cadf01f93 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:29.747978 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:29.749078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.749360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.749664 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.750631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:38:29.750631 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:29.753366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:29.767116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1405/2788] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:38:29.771170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828ed87-32b1-4e98-8680-6481e52a1857 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:29.780725 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828ed87-32b1-4e98-8680-6481e52a1857 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:29.785405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:29.786331 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.786609 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.786875 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.787494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:29.789618 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:29.826435 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1384/2789] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:38:29 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:38:29.830406 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:29.841654 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772bbd5-f2c7-45a5-8518-f957b53f6673 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:29.904324 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:29.905053 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.905364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.905615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.906269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:29.908504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:29.932135 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1406/2790] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:38:29 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:38:29.936314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:29.947090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39229240-2c53-4aae-af0c-20593b25111c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:29.951955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:29.952690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.953036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.953401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.954109 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:29.955813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:29.967398 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1385/2791] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:38:29.971708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:29.982896 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f26ab-efe4-4209-a550-40818379e681 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:29.988041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13081081-2a27-42f9-8caa-d01ea231a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:29.988865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081081-2a27-42f9-8caa-d01ea231a542 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:29.989152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081081-2a27-42f9-8caa-d01ea231a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:29.989429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081081-2a27-42f9-8caa-d01ea231a542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:29.990089 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13081081-2a27-42f9-8caa-d01ea231a542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:29.991703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13081081-2a27-42f9-8caa-d01ea231a542 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:30.003521 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1407/2792] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:38:30.008009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:30.018652 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917dbde-bb7c-4b72-9f8f-9926c528ef8c admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:30.023781 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:30.024503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:30.024782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:30.025058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] PATH_INFO: `/v3/projects/c9b066b7644b46ba827122d4ee844e2e/users/fd6855e787c943f9bf1b4c751b8204a1/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:30.041514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b066b7644b46ba827122d4ee844e2e, user_id=fd6855e787c943f9bf1b4c751b8204a1, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:30.045104 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:30.060309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1386/2793] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:38:30 2022] PUT /identity/v3/projects/c9b066b7644b46ba827122d4ee844e2e/users/fd6855e787c943f9bf1b4c751b8204a1/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:38:30.071984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5534aeb-9c1c-4d4f-84ff-e64aa58f1ecb None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:30.072376 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5534aeb-9c1c-4d4f-84ff-e64aa58f1ecb None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:30.072592 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5534aeb-9c1c-4d4f-84ff-e64aa58f1ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:30.105980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-c5534aeb-9c1c-4d4f-84ff-e64aa58f1ecb None None] MFA Rules not processed for user `fd6855e787c943f9bf1b4c751b8204a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:38:30.108334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c5534aeb-9c1c-4d4f-84ff-e64aa58f1ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:30.186209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1408/2794] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:38:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:38:30.193630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:30.195568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:30.210691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:30.266448 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b4223-23dd-468b-90b8-38c57598a259 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:30.270525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:30.271303 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:30.271678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:30.272044 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:30.281504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:30.283124 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:30.292672 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1387/2795] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:38:34.077936 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:34.078407 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:34.078504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:34.097347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] MFA Rules not processed for user `08babdf38b1f43568be6d4b82f983805`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:38:34.098620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:34.111017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:34.157529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1409/2796] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:38:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:38:35.522845 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:35.589795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c28e-bc00-44f9-82ce-dbe0c5e75af6 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:35.594424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:35.595055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:35.595335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:35.595610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] PATH_INFO: `/v3/users/fd6855e787c943f9bf1b4c751b8204a1` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:35.596757 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6855e787c943f9bf1b4c751b8204a1)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:35.598705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:35.648392 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6855e787c943f9bf1b4c751b8204a1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:35.649176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:35.650596 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:35.655997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6855e787c943f9bf1b4c751b8204a1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:35.656752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6855e787c943f9bf1b4c751b8204a1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:35.670228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6855e787c943f9bf1b4c751b8204a1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:35.677950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-86828449-6966-46cc-93f4-521a62842566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6855e787c943f9bf1b4c751b8204a1'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:35.685510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1388/2797] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:38:35 2022] DELETE /identity/v3/users/fd6855e787c943f9bf1b4c751b8204a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:38:35.689966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:35.690322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:35.690594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:35.709335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:38:35.710515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:35.711933 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dacc6-3b43-4540-b3f4-51fec3019418 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:35.740864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:35.762034 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:35.762650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:35.762927 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:35.763199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:35.764974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:35.775473 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1389/2798] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:38:35.785333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:35.786741 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:35.801645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0885b-71e6-4124-9110-e99f33cdbdbe None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:35.807501 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:35.808167 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:35.808629 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:35.808867 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:35.819310 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:35.820761 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:35.831986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1390/2799] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:38:35.849111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:35.850560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:35.866186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1410/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:38:36.201429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:36.203185 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:36.218004 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d981014-0569-4d03-a78a-feed142b5e40 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:36.223248 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:36.224142 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:36.224537 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:36.225046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] PATH_INFO: `/v3/projects/c9b066b7644b46ba827122d4ee844e2e` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:36.226277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b066b7644b46ba827122d4ee844e2e)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:36.228816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:36.279393 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b066b7644b46ba827122d4ee844e2e', 'request_id': 'req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:36.286463 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b066b7644b46ba827122d4ee844e2e', 'request_id': 'req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:36.292900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b066b7644b46ba827122d4ee844e2e', 'request_id': 'req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:36.305877 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] The token cache is being invalidate because project c9b066b7644b46ba827122d4ee844e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:38:36.306292 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:36.307000 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:38:36.308610 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1391/2801] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:38:36 2022] DELETE /identity/v3/projects/c9b066b7644b46ba827122d4ee844e2e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:38:37.499771 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:37.501365 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:37.512659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a52cc-3f42-4ebc-9416-46e87d3a0ff5 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:37.540868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:37.565363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:37.565893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:37.566180 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:37.566457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:37.568229 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:37.578463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:37.579897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:37.589505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1411/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:38:46.302718 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:47.585616 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=13 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:38:49.025630 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:38:49.027179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:49.102513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4d6a-025f-4b21-b2a9-9085b41954d4 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:38:49.108056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f29e57-1b90-4ce5-95fd-3772ffcdada2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:38:49.108701 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29e57-1b90-4ce5-95fd-3772ffcdada2 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:38:49.108986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29e57-1b90-4ce5-95fd-3772ffcdada2 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:38:49.109263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29e57-1b90-4ce5-95fd-3772ffcdada2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:38:49.111068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-d8f29e57-1b90-4ce5-95fd-3772ffcdada2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:38:49.123538 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f29e57-1b90-4ce5-95fd-3772ffcdada2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:38:49.125160 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f29e57-1b90-4ce5-95fd-3772ffcdada2 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:38:49.135780 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1392/2803] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:38:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:38:59.131251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=34 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:40:06.678756 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:40:06.680295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:40:06.734937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3610ff-86ba-4510-a7e8-b438f38d01aa service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:40:06.738974 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:40:06.739570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:40:06.739850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:40:06.740120 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:40:06.741846 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:40:06.797420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:40:06.798871 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:40:06.807942 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1412/2804] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:40:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:40:16.265803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd24b-a40a-436c-a209-f49bda9015a2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:40:16.266341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd24b-a40a-436c-a209-f49bda9015a2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:40:16.266341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd24b-a40a-436c-a209-f49bda9015a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:40:16.285930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-55abd24b-a40a-436c-a209-f49bda9015a2 None None] MFA Rules not processed for user `08babdf38b1f43568be6d4b82f983805`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:40:16.287118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-55abd24b-a40a-436c-a209-f49bda9015a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:40:16.293823 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1393/2805] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:40:16.803880 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=48 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:40:16.909389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:40:16.910894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:40:16.981558 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710c75-03fb-4aa6-8104-a98ca96eb39a service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:40:16.986891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:40:16.987489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:40:16.987798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:40:16.988100 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:40:16.989860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:40:17.001423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:40:17.002976 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:40:17.015888 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1413/2806] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:40:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:40:25.602266 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abd24b-a40a-436c-a209-f49bda9015a2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:40:25.616560 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abd24b-a40a-436c-a209-f49bda9015a2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:40:25.622045 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c83d5e7a41404bacb2b4d18daf040aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:40:25.622647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:40:25.622948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:40:25.623205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:40:25.625228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:40:25.638134 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:40:25.639713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:40:25.650099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1394/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:40:27.010462 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=32 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:40:35.645650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=9 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:41:17.560924 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:41:17.562306 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:41:17.575830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad226c-689c-4070-8cee-b90c37520ddc service placement] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:41:17.580890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:41:17.581477 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:41:17.581753 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:41:17.582021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:41:17.583699 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:41:17.594660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:41:17.596203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:41:17.606338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1414/2808] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:41:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:41:18.173402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:41:18.175235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:41:18.188380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7b54f-e70c-4fc2-8931-0125d226b1a7 service nova] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:41:18.192696 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:41:18.193379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:41:18.193663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:41:18.193932 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:41:18.195616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:41:18.205506 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:41:18.206950 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:41:18.216983 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1395/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:41:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:41:18.294960 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:41:18.304127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2893ac-1d6f-4dc3-8497-61260b611c93 service placement] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:41:18.308421 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:41:18.309032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:41:18.309314 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:41:18.309589 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:41:18.311363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:41:18.325369 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:41:18.326787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:41:18.338988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1415/2810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:41:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 05:41:28.213003 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:41:28.333730 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=12 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:41:59.560477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:41:59.561843 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:41:59.572032 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bfc86-34a5-4532-8ea0-ef123451df32 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:41:59.575620 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:41:59.576204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:41:59.576516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:41:59.576790 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:41:59.578415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:41:59.639477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:41:59.640937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:41:59.650288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1396/2811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:02.369327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:02.381743 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc66d6-9e0f-4b5d-a180-c509aa46db74 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:02.386994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:02.388111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:02.388370 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:02.388862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:02.390912 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:02.404386 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:02.406099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:02.418132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1416/2812] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:02.439973 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:02.441476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:02.460711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce7360-998d-4f52-ac3a-4927cce54c1b service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:02.465734 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:02.466258 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:02.466534 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:02.467566 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] PATH_INFO: `/v3/users/08babdf38b1f43568be6d4b82f983805` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:02.468908 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08babdf38b1f43568be6d4b82f983805)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:02.470828 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:02.517887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08babdf38b1f43568be6d4b82f983805'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.525723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08babdf38b1f43568be6d4b82f983805'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.526350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08babdf38b1f43568be6d4b82f983805'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.538096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08babdf38b1f43568be6d4b82f983805'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.544903 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9f5693f2-178c-41b5-873e-7448b1f93413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08babdf38b1f43568be6d4b82f983805'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.550663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1397/2813] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:02 2022] DELETE /identity/v3/users/08babdf38b1f43568be6d4b82f983805 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:02.720705 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:02.732567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838211-df07-4c6c-8588-cf76e2a2a2ed service placement] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:02.789483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:02.790107 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:02.790380 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:02.790650 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] PATH_INFO: `/v3/projects/a1269da257f44bbc834c5f610748f629` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:02.791990 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1269da257f44bbc834c5f610748f629)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:02.793954 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:02.837884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1269da257f44bbc834c5f610748f629', 'request_id': 'req-948e69bc-3c17-4921-8bba-eacac05b4b5f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.846151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1269da257f44bbc834c5f610748f629', 'request_id': 'req-948e69bc-3c17-4921-8bba-eacac05b4b5f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.851850 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1269da257f44bbc834c5f610748f629', 'request_id': 'req-948e69bc-3c17-4921-8bba-eacac05b4b5f'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.863103 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] The token cache is being invalidate because project a1269da257f44bbc834c5f610748f629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:02.863398 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.864036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-948e69bc-3c17-4921-8bba-eacac05b4b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:02.866094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1417/2814] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:02 2022] DELETE /identity/v3/projects/a1269da257f44bbc834c5f610748f629 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:02.870966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bfaf8-8167-4c45-a875-d9418a70e1c2 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:02.871287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bfaf8-8167-4c45-a875-d9418a70e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:02.871568 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bfaf8-8167-4c45-a875-d9418a70e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:02.892031 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-9b2bfaf8-8167-4c45-a875-d9418a70e1c2 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:02.893276 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9b2bfaf8-8167-4c45-a875-d9418a70e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:02.950597 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1398/2815] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:02.958257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9480f-fff1-4aea-a3cc-eb6b6ddc3419 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:02.958549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9480f-fff1-4aea-a3cc-eb6b6ddc3419 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:02.958862 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9480f-fff1-4aea-a3cc-eb6b6ddc3419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:02.978168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0ef9480f-fff1-4aea-a3cc-eb6b6ddc3419 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:02.979360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0ef9480f-fff1-4aea-a3cc-eb6b6ddc3419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:02.987147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1418/2816] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:02.991769 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bfaf8-8167-4c45-a875-d9418a70e1c2 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:03.001500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bfaf8-8167-4c45-a875-d9418a70e1c2 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:03.006726 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:03.007319 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.007602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.007878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.008558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:03.008866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:03.010465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:03.011880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:03.025968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1399/2817] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:42:03.027017 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9480f-fff1-4aea-a3cc-eb6b6ddc3419 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:03.036072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9480f-fff1-4aea-a3cc-eb6b6ddc3419 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:03.040755 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:03.041344 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.041623 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.041895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.042529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:03.044435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:03.071675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1419/2818] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:03 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:42:03.075930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:03.085902 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093272-60c9-4a27-99f2-dad30489f916 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:03.141460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:03.142060 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.142344 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.142619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.143246 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:03.145208 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:03.166153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1400/2819] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:03 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:03.170319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:03.181338 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f8510-26f6-4ea4-88b6-bccac0d03794 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:03.186018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:03.186615 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.186916 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.187168 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.187803 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:03.189422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:03.199203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1420/2820] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:03.203114 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:03.212712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d441-0c96-4ab9-8f29-15bdc7a09891 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:03.217268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162080f4-390a-4d2b-8e3d-1cbaa11ec1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:03.217852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162080f4-390a-4d2b-8e3d-1cbaa11ec1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.218131 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162080f4-390a-4d2b-8e3d-1cbaa11ec1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.218405 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162080f4-390a-4d2b-8e3d-1cbaa11ec1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.219047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162080f4-390a-4d2b-8e3d-1cbaa11ec1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:03.220665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162080f4-390a-4d2b-8e3d-1cbaa11ec1b3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:03.231357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1401/2821] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:03.235288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:03.245732 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f4a01-a1e7-4d73-a287-fc94e1975a03 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:03.250227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:03.251111 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.251389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.251663 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] PATH_INFO: `/v3/projects/227732d3bffc4672b24a4a5cb075d413/users/dbc362a4470e41a79086ec1c2a54b9cb/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.265662 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227732d3bffc4672b24a4a5cb075d413, user_id=dbc362a4470e41a79086ec1c2a54b9cb, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:03.268315 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:03.281066 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1421/2822] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:03 2022] PUT /identity/v3/projects/227732d3bffc4672b24a4a5cb075d413/users/dbc362a4470e41a79086ec1c2a54b9cb/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:03.285974 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8090947-a6aa-4ece-83e9-33e7b94bbb83 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.286264 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8090947-a6aa-4ece-83e9-33e7b94bbb83 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.287039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8090947-a6aa-4ece-83e9-33e7b94bbb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.306971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-e8090947-a6aa-4ece-83e9-33e7b94bbb83 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:03.308406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e8090947-a6aa-4ece-83e9-33e7b94bbb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:03.372188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1402/2823] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:03.382069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:03.383784 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:03.397905 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:03.443271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea8494-3a54-47fe-a64a-7ce56e46ce94 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:03.447090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:03.447836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:03.447985 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:03.448265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:03.457595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:03.459457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:03.468745 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1422/2824] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:04.074494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21715992-56c7-4643-acf8-c7d91ad9af38 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:04.075035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21715992-56c7-4643-acf8-c7d91ad9af38 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:04.075035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21715992-56c7-4643-acf8-c7d91ad9af38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:04.103165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-21715992-56c7-4643-acf8-c7d91ad9af38 None None] MFA Rules not processed for user `dbc362a4470e41a79086ec1c2a54b9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:04.104455 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-21715992-56c7-4643-acf8-c7d91ad9af38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:04.169873 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1403/2825] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:04.174414 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:04.184556 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2ccc-7eb0-419f-bf0e-ed26d7e214e4 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:04.189078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:04.189670 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:04.189956 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:04.190213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:04.190836 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:04.193764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:04.223214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1423/2826] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:04 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:04.227853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21715992-56c7-4643-acf8-c7d91ad9af38 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:04.233361 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:04.240110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21715992-56c7-4643-acf8-c7d91ad9af38 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:04.297356 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:04.297884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:04.298161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:04.298449 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:04.299072 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:04.301028 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:04.321966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1404/2827] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:04 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:04.326330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:04.337385 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553e15-7c26-49f5-b2bc-52b31334c79c admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:04.342160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:04.342761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:04.343069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:04.343345 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:04.344060 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:04.345682 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:04.357957 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1424/2828] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:04.362056 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:04.371720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566513e-98ce-41ff-8b4c-c7ca87c55e81 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:04.376724 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:04.377407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:04.377690 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:04.377998 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] PATH_INFO: `/v3/projects/433883e3b6be45eb827274c83ccf06ff/users/ed0b2aa7f2df4c34abdc7d118e1b5797/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:04.392526 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433883e3b6be45eb827274c83ccf06ff, user_id=ed0b2aa7f2df4c34abdc7d118e1b5797, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:04.395329 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:04.407961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1405/2829] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:04 2022] PUT /identity/v3/projects/433883e3b6be45eb827274c83ccf06ff/users/ed0b2aa7f2df4c34abdc7d118e1b5797/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:04.412504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:04.422295 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0481466-1f21-4232-92d6-f146f3af574a admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:04.476630 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f3087-6a23-4b93-ae66-3d8234772ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:04.477333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3087-6a23-4b93-ae66-3d8234772ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:04.477619 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3087-6a23-4b93-ae66-3d8234772ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:04.477891 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3087-6a23-4b93-ae66-3d8234772ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:04.478538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f3087-6a23-4b93-ae66-3d8234772ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:04.480227 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f3087-6a23-4b93-ae66-3d8234772ed3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:04.490272 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1425/2830] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:04.494403 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:04.504707 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38e996-0d32-43dc-a812-fb4905a97839 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:04.509755 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:04.510385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:04.510664 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:04.510938 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] PATH_INFO: `/v3/projects/433883e3b6be45eb827274c83ccf06ff/users/ed0b2aa7f2df4c34abdc7d118e1b5797/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:04.512837 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433883e3b6be45eb827274c83ccf06ff, user_id=ed0b2aa7f2df4c34abdc7d118e1b5797, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:04.515451 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:04.525792 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1406/2831] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:04 2022] PUT /identity/v3/projects/433883e3b6be45eb827274c83ccf06ff/users/ed0b2aa7f2df4c34abdc7d118e1b5797/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:05.156841 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b424ac-afab-4143-8aad-d8fd4ca25429 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:05.157130 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b424ac-afab-4143-8aad-d8fd4ca25429 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:05.157409 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b424ac-afab-4143-8aad-d8fd4ca25429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:05.186496 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-78b424ac-afab-4143-8aad-d8fd4ca25429 None None] MFA Rules not processed for user `ed0b2aa7f2df4c34abdc7d118e1b5797`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:05.187703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-78b424ac-afab-4143-8aad-d8fd4ca25429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:05.261634 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1426/2832] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:05 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:05.703471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:05.705262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:05.779457 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd286e3-a014-4aa2-b2d6-cb330800c2f6 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:05.784543 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:05.785154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:05.785436 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:05.785709 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:05.788359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:05.800177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:05.801811 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:05.812359 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1407/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:06.264816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b424ac-afab-4143-8aad-d8fd4ca25429 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:06.270584 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:06.330427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b424ac-afab-4143-8aad-d8fd4ca25429 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:06.334987 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:06.335612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:06.335886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:06.336166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] PATH_INFO: `/v3/users/dbc362a4470e41a79086ec1c2a54b9cb` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:06.337318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc362a4470e41a79086ec1c2a54b9cb)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:06.339236 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:06.384544 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc362a4470e41a79086ec1c2a54b9cb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.392346 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc362a4470e41a79086ec1c2a54b9cb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.393020 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc362a4470e41a79086ec1c2a54b9cb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.399829 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc362a4470e41a79086ec1c2a54b9cb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.411318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc362a4470e41a79086ec1c2a54b9cb'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.417692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1427/2834] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:06 2022] DELETE /identity/v3/users/dbc362a4470e41a79086ec1c2a54b9cb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:06.591486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:06.602209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9f30-5150-4586-9be4-98936d7887fe service placement] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:06.647012 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:06.662705 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:06.663271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:06.663548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:06.663820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] PATH_INFO: `/v3/projects/227732d3bffc4672b24a4a5cb075d413` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:06.664944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227732d3bffc4672b24a4a5cb075d413)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:06.666829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:06.712313 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227732d3bffc4672b24a4a5cb075d413', 'request_id': 'req-a2442bb1-47b8-428c-9992-6620ce8239a5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.717861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227732d3bffc4672b24a4a5cb075d413', 'request_id': 'req-a2442bb1-47b8-428c-9992-6620ce8239a5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.723916 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227732d3bffc4672b24a4a5cb075d413', 'request_id': 'req-a2442bb1-47b8-428c-9992-6620ce8239a5'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.736885 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] The token cache is being invalidate because project 227732d3bffc4672b24a4a5cb075d413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:06.737170 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.737774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.740007 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1408/2835] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:06 2022] DELETE /identity/v3/projects/227732d3bffc4672b24a4a5cb075d413 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:06.743804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:06.745232 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:06.758779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab8b8-4eec-4666-b486-806f35faece3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:06.813147 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:06.813774 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:06.814057 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:06.814335 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] PATH_INFO: `/v3/users/ed0b2aa7f2df4c34abdc7d118e1b5797` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:06.815487 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0b2aa7f2df4c34abdc7d118e1b5797)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:06.817486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:06.844412 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:06.867157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0b2aa7f2df4c34abdc7d118e1b5797'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.873779 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0b2aa7f2df4c34abdc7d118e1b5797'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.874572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0b2aa7f2df4c34abdc7d118e1b5797'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.882134 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0b2aa7f2df4c34abdc7d118e1b5797'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.893824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-278cedfb-ea43-4cab-803c-8d0e671e740c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0b2aa7f2df4c34abdc7d118e1b5797'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:06.899660 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1428/2836] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:06 2022] DELETE /identity/v3/users/ed0b2aa7f2df4c34abdc7d118e1b5797 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:07.067616 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.069714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:07.083183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442bb1-47b8-428c-9992-6620ce8239a5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.140030 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.140703 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.140988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.141263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] PATH_INFO: `/v3/projects/433883e3b6be45eb827274c83ccf06ff` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.142424 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=433883e3b6be45eb827274c83ccf06ff)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.144382 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.191710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433883e3b6be45eb827274c83ccf06ff', 'request_id': 'req-aa6864f4-3915-43c4-9bde-319f379827c3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:07.197919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433883e3b6be45eb827274c83ccf06ff', 'request_id': 'req-aa6864f4-3915-43c4-9bde-319f379827c3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:07.204009 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433883e3b6be45eb827274c83ccf06ff', 'request_id': 'req-aa6864f4-3915-43c4-9bde-319f379827c3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:07.216404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] The token cache is being invalidate because project 433883e3b6be45eb827274c83ccf06ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:07.216720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:07.217340 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aa6864f4-3915-43c4-9bde-319f379827c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:07.218795 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1409/2837] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:07 2022] DELETE /identity/v3/projects/433883e3b6be45eb827274c83ccf06ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:07.223685 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e17e7a-d77d-48c0-980e-2eb62f53026a None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.224001 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e17e7a-d77d-48c0-980e-2eb62f53026a None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.224332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e17e7a-d77d-48c0-980e-2eb62f53026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.243822 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-d4e17e7a-d77d-48c0-980e-2eb62f53026a None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:07.245063 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-d4e17e7a-d77d-48c0-980e-2eb62f53026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:07.301754 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1429/2838] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 05:42:07.310090 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093057-1aba-4941-bedc-5a88cba3c688 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.310452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093057-1aba-4941-bedc-5a88cba3c688 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.310742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093057-1aba-4941-bedc-5a88cba3c688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.319941 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:07.332523 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-5d093057-1aba-4941-bedc-5a88cba3c688 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:07.333716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-5d093057-1aba-4941-bedc-5a88cba3c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:07.341508 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1410/2839] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:07.345787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e17e7a-d77d-48c0-980e-2eb62f53026a None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.355347 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e17e7a-d77d-48c0-980e-2eb62f53026a None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.360249 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.360878 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.361161 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.361437 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.362090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:07.362397 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.364069 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.376122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1430/2840] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:42:07.380948 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d093057-1aba-4941-bedc-5a88cba3c688 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.389866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d093057-1aba-4941-bedc-5a88cba3c688 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.394490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.395513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.395513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.395716 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.396351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.398238 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.426091 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1411/2841] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:07 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:07.430869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.440819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c5731-601e-420e-9df9-323e7b49dbac admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.495299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.495920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.496199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.496500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.497189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.499104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.519859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1431/2842] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:07 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:07.524162 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.534053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b94c-df7d-47dd-8c3b-029da194062f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.538591 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.539177 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.539453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.539722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.540390 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.541962 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.553039 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1412/2843] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:07.556907 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.566488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab89b7-751f-4cf6-9ee4-563a38f26e7b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.571636 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee0040-9544-4507-b9b4-a6e12f906b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.572223 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0040-9544-4507-b9b4-a6e12f906b5e admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.572542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0040-9544-4507-b9b4-a6e12f906b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.572815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0040-9544-4507-b9b4-a6e12f906b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.573450 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee0040-9544-4507-b9b4-a6e12f906b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.575023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee0040-9544-4507-b9b4-a6e12f906b5e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.585401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1432/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:07.589204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.598816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcdd27-1e29-43e9-a526-bacdc94e633e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.603952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.604619 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.604894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.605165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] PATH_INFO: `/v3/projects/7c0ca28f6d77457bb9201f56556064ed/users/44e5b18c504e4d53b96a3e5273ad7eae/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.619944 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0ca28f6d77457bb9201f56556064ed, user_id=44e5b18c504e4d53b96a3e5273ad7eae, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.622667 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.635580 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1413/2845] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:07 2022] PUT /identity/v3/projects/7c0ca28f6d77457bb9201f56556064ed/users/44e5b18c504e4d53b96a3e5273ad7eae/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:07.647018 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8778-a013-4e50-af08-a24e500fd6ca None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.647303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8778-a013-4e50-af08-a24e500fd6ca None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.647574 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8778-a013-4e50-af08-a24e500fd6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.668736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:07.679792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-809c8778-a013-4e50-af08-a24e500fd6ca None None] MFA Rules not processed for user `44e5b18c504e4d53b96a3e5273ad7eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:07.681074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-809c8778-a013-4e50-af08-a24e500fd6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:07.743366 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1433/2846] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:07.747827 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.807600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b264a5-449b-4fa0-9b3c-35e37cc7e33f admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.812161 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.812770 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.813051 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.813321 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.813955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.815831 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.841362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1414/2847] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:07 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:07.845928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8778-a013-4e50-af08-a24e500fd6ca None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.857303 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8778-a013-4e50-af08-a24e500fd6ca None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.913382 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.913983 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.914263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.914538 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.915160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.917116 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.937817 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1434/2848] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:07 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:07.941800 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.951993 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755c22-8040-4ac0-af98-e4fd22e4a689 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.956577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.957151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.957429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.957698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:07.958816 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:07.960430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:07.972138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1415/2849] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:07.976826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:07.986508 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e94b-ea2f-460e-a9f6-5d2378a8c8cd admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:07.991097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:07.991739 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:07.992019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:07.992328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] PATH_INFO: `/v3/projects/ede03fb516114e619ae3e4ebf851cff6/users/9beb43c986994dc8b340f3b59f4a7b42/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:08.006834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede03fb516114e619ae3e4ebf851cff6, user_id=9beb43c986994dc8b340f3b59f4a7b42, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:08.009461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:08.022598 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1435/2850] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:07 2022] PUT /identity/v3/projects/ede03fb516114e619ae3e4ebf851cff6/users/9beb43c986994dc8b340f3b59f4a7b42/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:08.026466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:08.036175 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cf37b-c316-4e73-a404-f0b666fd4963 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:08.090878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e111dd-4585-4b50-8eeb-b8767526a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:08.091477 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e111dd-4585-4b50-8eeb-b8767526a9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:08.091768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e111dd-4585-4b50-8eeb-b8767526a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:08.092041 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e111dd-4585-4b50-8eeb-b8767526a9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:08.092713 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e111dd-4585-4b50-8eeb-b8767526a9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:08.094594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e111dd-4585-4b50-8eeb-b8767526a9e0 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:08.105025 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1416/2851] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:08.109065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:08.118934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e03d5-f882-47a3-9cc1-94b0e4fd7c42 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:08.123442 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:08.124078 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:08.124387 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:08.124658 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] PATH_INFO: `/v3/projects/ede03fb516114e619ae3e4ebf851cff6/users/9beb43c986994dc8b340f3b59f4a7b42/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:08.126821 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede03fb516114e619ae3e4ebf851cff6, user_id=9beb43c986994dc8b340f3b59f4a7b42, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:08.129476 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:08.139364 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1436/2852] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:08 2022] PUT /identity/v3/projects/ede03fb516114e619ae3e4ebf851cff6/users/9beb43c986994dc8b340f3b59f4a7b42/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:08.149806 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e463aa-2cc3-484e-8391-47b1866f5f4f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:08.150097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e463aa-2cc3-484e-8391-47b1866f5f4f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:08.150380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e463aa-2cc3-484e-8391-47b1866f5f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:08.170900 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:08.179409 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-33e463aa-2cc3-484e-8391-47b1866f5f4f None None] MFA Rules not processed for user `9beb43c986994dc8b340f3b59f4a7b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:08.180681 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-33e463aa-2cc3-484e-8391-47b1866f5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:08.246602 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1417/2853] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:08.257612 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:08.259225 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:08.314114 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91ddd-75b8-4043-a384-3d0ce1b95b2b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:08.317781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce1cd5-2711-4b21-9551-fb4dc7e4b1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:08.318367 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce1cd5-2711-4b21-9551-fb4dc7e4b1be service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:08.318643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce1cd5-2711-4b21-9551-fb4dc7e4b1be service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:08.318910 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce1cd5-2711-4b21-9551-fb4dc7e4b1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:08.324649 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:08.329277 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce1cd5-2711-4b21-9551-fb4dc7e4b1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:08.330780 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce1cd5-2711-4b21-9551-fb4dc7e4b1be service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:08.341127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1437/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:09.657268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e463aa-2cc3-484e-8391-47b1866f5f4f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:09.717997 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e463aa-2cc3-484e-8391-47b1866f5f4f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:09.722483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:09.723101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:09.723380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:09.723650 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] PATH_INFO: `/v3/users/44e5b18c504e4d53b96a3e5273ad7eae` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:09.725476 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e5b18c504e4d53b96a3e5273ad7eae)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:09.727378 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:09.770721 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e5b18c504e4d53b96a3e5273ad7eae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:09.778166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e5b18c504e4d53b96a3e5273ad7eae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:09.778813 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e5b18c504e4d53b96a3e5273ad7eae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:09.802327 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e5b18c504e4d53b96a3e5273ad7eae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:09.809173 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e5b18c504e4d53b96a3e5273ad7eae'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:09.814991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1418/2855] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:09 2022] DELETE /identity/v3/users/44e5b18c504e4d53b96a3e5273ad7eae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:09.819567 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:09.820065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:09.820178 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:09.838866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:09.840039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:09.898832 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1438/2856] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:09.908635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:09.910066 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:09.928026 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:09.968444 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f44f-1025-4202-9926-4ff2cf7ebd6a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:09.977107 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:09.977776 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:09.978055 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:09.978335 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:09.989699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:09.991176 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:10.000532 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1419/2857] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:10.269424 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:10.270869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:10.288173 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaea513-d16b-49db-83ba-4f47eba56885 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:10.292893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:10.293534 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:10.293859 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:10.294122 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] PATH_INFO: `/v3/projects/7c0ca28f6d77457bb9201f56556064ed` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:10.295401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0ca28f6d77457bb9201f56556064ed)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:10.297256 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:10.342655 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0ca28f6d77457bb9201f56556064ed', 'request_id': 'req-cac5442d-031f-4e35-955b-c27ef37b4793'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.349570 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0ca28f6d77457bb9201f56556064ed', 'request_id': 'req-cac5442d-031f-4e35-955b-c27ef37b4793'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.354934 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0ca28f6d77457bb9201f56556064ed', 'request_id': 'req-cac5442d-031f-4e35-955b-c27ef37b4793'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.366244 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] The token cache is being invalidate because project 7c0ca28f6d77457bb9201f56556064ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:10.366529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.367150 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.368635 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1439/2858] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:10 2022] DELETE /identity/v3/projects/7c0ca28f6d77457bb9201f56556064ed => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:10.372736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:10.382869 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5101-f6d9-434e-90e4-dc3869ebebe2 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:10.436617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:10.437236 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:10.437514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:10.437784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] PATH_INFO: `/v3/users/9beb43c986994dc8b340f3b59f4a7b42` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:10.438878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9beb43c986994dc8b340f3b59f4a7b42)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:10.440834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:10.486648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9beb43c986994dc8b340f3b59f4a7b42'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.493720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9beb43c986994dc8b340f3b59f4a7b42'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.494542 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9beb43c986994dc8b340f3b59f4a7b42'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.507146 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9beb43c986994dc8b340f3b59f4a7b42'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.513953 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-58f7ee12-9a42-40a3-b692-63eb411f291c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9beb43c986994dc8b340f3b59f4a7b42'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.519588 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1420/2859] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:10 2022] DELETE /identity/v3/users/9beb43c986994dc8b340f3b59f4a7b42 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:10.781198 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:10.782749 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:10.797128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5442d-031f-4e35-955b-c27ef37b4793 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:10.855499 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:10.856155 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:10.856429 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:10.856700 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] PATH_INFO: `/v3/projects/ede03fb516114e619ae3e4ebf851cff6` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:10.857857 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede03fb516114e619ae3e4ebf851cff6)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:10.860026 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:10.881356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:10.906881 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede03fb516114e619ae3e4ebf851cff6', 'request_id': 'req-71164fcb-d72d-4c36-9309-fb8e7355bf5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.914463 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede03fb516114e619ae3e4ebf851cff6', 'request_id': 'req-71164fcb-d72d-4c36-9309-fb8e7355bf5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.920455 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede03fb516114e619ae3e4ebf851cff6', 'request_id': 'req-71164fcb-d72d-4c36-9309-fb8e7355bf5e'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.931917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] The token cache is being invalidate because project ede03fb516114e619ae3e4ebf851cff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:10.932203 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.932868 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-71164fcb-d72d-4c36-9309-fb8e7355bf5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:10.934305 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1440/2860] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:10 2022] DELETE /identity/v3/projects/ede03fb516114e619ae3e4ebf851cff6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:10.939129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88070-f027-4d4a-b28e-bef232aac71f None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:10.939612 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88070-f027-4d4a-b28e-bef232aac71f None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:10.939722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88070-f027-4d4a-b28e-bef232aac71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:10.959172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-dbd88070-f027-4d4a-b28e-bef232aac71f None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:10.960379 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-dbd88070-f027-4d4a-b28e-bef232aac71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:10.993708 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:11.023138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1421/2861] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:11.030980 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec6d02-4e75-4254-a83e-960a2d69c558 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.031271 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec6d02-4e75-4254-a83e-960a2d69c558 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.031554 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec6d02-4e75-4254-a83e-960a2d69c558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.051255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-1fec6d02-4e75-4254-a83e-960a2d69c558 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:11.052991 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-1fec6d02-4e75-4254-a83e-960a2d69c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:11.060865 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1441/2862] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:11.064905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd88070-f027-4d4a-b28e-bef232aac71f None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.074968 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd88070-f027-4d4a-b28e-bef232aac71f None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.079404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.079988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.080265 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.080562 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.081193 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:11.081490 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.083062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.094111 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1422/2863] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:42:11.098213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec6d02-4e75-4254-a83e-960a2d69c558 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.107290 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec6d02-4e75-4254-a83e-960a2d69c558 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.111851 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.112478 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.112761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.113032 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.113651 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.116055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.143444 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1442/2864] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:11 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:11.147924 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.157767 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6050a-c6a9-41c6-a8db-af862ade0594 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.212297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.212899 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.213180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.213454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.214068 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.215959 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.238531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1423/2865] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:11 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:11.242611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.253152 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd0104-16fe-40d7-a765-6c8b3bd5090b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.257726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.258322 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.258600 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.258874 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.259517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.261124 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.271204 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1443/2866] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:11.274954 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.285083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21161e-86d3-4bfb-a3bd-698f66e3a8f1 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.290391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43972a32-006a-4206-8c61-f110a8ba91ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.290996 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972a32-006a-4206-8c61-f110a8ba91ac admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.291290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972a32-006a-4206-8c61-f110a8ba91ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.291564 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972a32-006a-4206-8c61-f110a8ba91ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.292235 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43972a32-006a-4206-8c61-f110a8ba91ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.294033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43972a32-006a-4206-8c61-f110a8ba91ac admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.305174 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1424/2867] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:11.309490 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.319555 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf776b-bfb2-46be-be95-3d9ea4d58241 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.324099 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.324769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.325043 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.325336 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] PATH_INFO: `/v3/projects/99f8081ca01641c0b1f2d4276d85995a/users/3a3d9efdd6264dadb86983f6a263cd08/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.339726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f8081ca01641c0b1f2d4276d85995a, user_id=3a3d9efdd6264dadb86983f6a263cd08, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.342396 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.355947 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1444/2868] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:11 2022] PUT /identity/v3/projects/99f8081ca01641c0b1f2d4276d85995a/users/3a3d9efdd6264dadb86983f6a263cd08/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:11.418524 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9ed0-ed30-4b97-b750-9e4e0b7d8d96 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.418738 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9ed0-ed30-4b97-b750-9e4e0b7d8d96 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.418995 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9ed0-ed30-4b97-b750-9e4e0b7d8d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.446615 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-46db9ed0-ed30-4b97-b750-9e4e0b7d8d96 None None] MFA Rules not processed for user `3a3d9efdd6264dadb86983f6a263cd08`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:11.447819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-46db9ed0-ed30-4b97-b750-9e4e0b7d8d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:11.510460 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1425/2869] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:11.514984 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.575289 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76e5ad-377a-436f-b0f6-c6bce97fdb4a admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.579917 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.580543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.580824 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.581094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.581724 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.584242 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.609792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1445/2870] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:11 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:11.613789 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9ed0-ed30-4b97-b750-9e4e0b7d8d96 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.624052 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9ed0-ed30-4b97-b750-9e4e0b7d8d96 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.653600 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:11.679570 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.680101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.680410 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.680684 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.681305 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.683204 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.703990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1426/2871] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:11 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:11.707932 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.718611 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f702d-3664-4633-a6b5-21ea89ee6cdb admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.723291 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.723900 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.724167 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.724475 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.725149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.726734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.736998 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1446/2872] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:11.741322 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.751309 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f252eb-c16f-410e-9776-7a2f830fd8f9 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.756486 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.757121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.757401 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.757702 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] PATH_INFO: `/v3/projects/405678c875f740e6a3cd60838b07c1df/users/f55e1b6c2eb0426ab74d26c7fb887964/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.771894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405678c875f740e6a3cd60838b07c1df, user_id=f55e1b6c2eb0426ab74d26c7fb887964, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.774578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.787819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1427/2873] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:11 2022] PUT /identity/v3/projects/405678c875f740e6a3cd60838b07c1df/users/f55e1b6c2eb0426ab74d26c7fb887964/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:11.791722 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.801524 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62e2b6-193b-4274-bdb8-adfc19ce6ce0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.816792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:11.862041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae379d9e-7a3f-4a73-b2ee-95b751e77d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.862659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379d9e-7a3f-4a73-b2ee-95b751e77d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.862941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379d9e-7a3f-4a73-b2ee-95b751e77d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.863218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379d9e-7a3f-4a73-b2ee-95b751e77d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.863858 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae379d9e-7a3f-4a73-b2ee-95b751e77d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.866015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae379d9e-7a3f-4a73-b2ee-95b751e77d2c admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.875545 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1447/2874] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:11.880046 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:11.890583 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43b0aa-05ef-44aa-ae7e-8fb312fbbb44 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:11.895118 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:11.895775 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.896047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.896350 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] PATH_INFO: `/v3/projects/405678c875f740e6a3cd60838b07c1df/users/f55e1b6c2eb0426ab74d26c7fb887964/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.898253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=405678c875f740e6a3cd60838b07c1df, user_id=f55e1b6c2eb0426ab74d26c7fb887964, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:11.900917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:11.910680 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1428/2875] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:11 2022] PUT /identity/v3/projects/405678c875f740e6a3cd60838b07c1df/users/f55e1b6c2eb0426ab74d26c7fb887964/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:11.920540 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed950f6-7478-4c4d-8ec5-eab4e864f26e None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:11.920834 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed950f6-7478-4c4d-8ec5-eab4e864f26e None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:11.921119 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed950f6-7478-4c4d-8ec5-eab4e864f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:11.949560 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-3ed950f6-7478-4c4d-8ec5-eab4e864f26e None None] MFA Rules not processed for user `f55e1b6c2eb0426ab74d26c7fb887964`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:11.950691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3ed950f6-7478-4c4d-8ec5-eab4e864f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:12.016750 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1448/2876] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:12.029504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:12.031220 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:12.087589 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cec250-ccac-44b3-ae28-f7f2a971f98b admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:12.091191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:12.091784 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:12.092062 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:12.092380 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:12.101678 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:12.103100 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:12.112188 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1429/2877] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:12.420787 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed950f6-7478-4c4d-8ec5-eab4e864f26e None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:12.429789 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed950f6-7478-4c4d-8ec5-eab4e864f26e None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:12.434329 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f55e1b6c2eb0426ab74d26c7fb887964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '405678c875f740e6a3cd60838b07c1df', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:12.434925 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:12.435214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:12.435492 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:12.436139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:12.436483 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:12.438075 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:12.449823 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1449/2878] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:42:12.453853 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:12.463407 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96499d0-a6b6-40d7-b81c-f662127a8d09 service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:12.468189 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f55e1b6c2eb0426ab74d26c7fb887964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '405678c875f740e6a3cd60838b07c1df', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:12.468766 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:12.469053 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:12.469333 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:12.469961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:12.471866 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:12.497967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1430/2879] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:12 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:12.502328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:12.512709 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd300853-6e7c-41f7-b981-e124b9402e20 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:12.567252 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f55e1b6c2eb0426ab74d26c7fb887964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '405678c875f740e6a3cd60838b07c1df', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:12.568413 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:12.568695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:12.568966 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:12.569597 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:12.569895 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:12.571470 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:12.582744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1450/2880] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 05:42:12.624704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:12.639179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f864-039c-459d-ae3e-287d5fd03e80 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:12.643818 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f55e1b6c2eb0426ab74d26c7fb887964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '405678c875f740e6a3cd60838b07c1df', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:12.644500 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:12.644919 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:12.645205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] PATH_INFO: `/v3/projects/4cd25633c6b244f8b28c62665d11ef41` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:12.646348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4cd25633c6b244f8b28c62665d11ef41)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:12.648262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:12.695452 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd25633c6b244f8b28c62665d11ef41', 'request_id': 'req-4d52bcf0-5f21-4953-8a21-a226486eb379'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:12.702152 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd25633c6b244f8b28c62665d11ef41', 'request_id': 'req-4d52bcf0-5f21-4953-8a21-a226486eb379'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:12.703980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:12.710689 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd25633c6b244f8b28c62665d11ef41', 'request_id': 'req-4d52bcf0-5f21-4953-8a21-a226486eb379'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:12.723698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] The token cache is being invalidate because project 4cd25633c6b244f8b28c62665d11ef41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:12.723927 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:12.724587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-4d52bcf0-5f21-4953-8a21-a226486eb379 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:12.726040 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1431/2881] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:12 2022] DELETE /identity/v3/projects/4cd25633c6b244f8b28c62665d11ef41 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:12.910899 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:12.913127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:12.934778 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=100 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:12.980068 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40ee6-28c2-4cab-a953-f947f3ca5914 tempest-VolumeQuotaClassesTest-790252282 tempest-VolumeQuotaClassesTest-790252282-project-admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:13.033920 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:13.034549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:13.034831 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:13.035106 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] PATH_INFO: `/v3/users/3a3d9efdd6264dadb86983f6a263cd08` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:13.036751 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3d9efdd6264dadb86983f6a263cd08)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:13.038675 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:13.082515 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3d9efdd6264dadb86983f6a263cd08'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.089952 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3d9efdd6264dadb86983f6a263cd08'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.090569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3d9efdd6264dadb86983f6a263cd08'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.097288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3d9efdd6264dadb86983f6a263cd08'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.109149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3d9efdd6264dadb86983f6a263cd08'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.115513 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1451/2882] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:12 2022] DELETE /identity/v3/users/3a3d9efdd6264dadb86983f6a263cd08 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:13.119930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:13.120450 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:13.120561 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:13.138951 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:13.140136 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:13.196857 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1432/2883] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:13.206599 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:13.208019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:13.261288 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:13.268327 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ad4d9-8527-44e9-b749-6cf838e71af0 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:13.275044 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:13.275520 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:13.275799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:13.276073 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:13.285401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:13.287440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:13.296677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1452/2884] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:13.556416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:13.558138 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:13.572700 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5680d46-a1fe-4cef-a160-fcaf36e518bc None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:13.577352 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:13.577989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:13.578268 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:13.578653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] PATH_INFO: `/v3/projects/99f8081ca01641c0b1f2d4276d85995a` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:13.579804 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f8081ca01641c0b1f2d4276d85995a)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:13.581753 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:13.628829 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f8081ca01641c0b1f2d4276d85995a', 'request_id': 'req-642c95b7-df1a-49bd-add8-635cac2d38d3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.634262 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f8081ca01641c0b1f2d4276d85995a', 'request_id': 'req-642c95b7-df1a-49bd-add8-635cac2d38d3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.640420 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f8081ca01641c0b1f2d4276d85995a', 'request_id': 'req-642c95b7-df1a-49bd-add8-635cac2d38d3'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.652587 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] The token cache is being invalidate because project 99f8081ca01641c0b1f2d4276d85995a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:13.652906 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.653513 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.655057 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1433/2885] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:13 2022] DELETE /identity/v3/projects/99f8081ca01641c0b1f2d4276d85995a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:13.659054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:13.669054 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219ec21-7f1c-4e2b-a0b1-b99cbf66b1b8 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:13.727518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:13.728142 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:13.728453 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:13.728727 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] PATH_INFO: `/v3/users/f55e1b6c2eb0426ab74d26c7fb887964` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:13.729842 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55e1b6c2eb0426ab74d26c7fb887964)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:13.731741 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:13.776259 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55e1b6c2eb0426ab74d26c7fb887964'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.783404 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55e1b6c2eb0426ab74d26c7fb887964'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.784065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55e1b6c2eb0426ab74d26c7fb887964'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.791856 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55e1b6c2eb0426ab74d26c7fb887964'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.804206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3de9b06e-f34e-4425-8377-03735d531d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55e1b6c2eb0426ab74d26c7fb887964'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:13.809982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1453/2886] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:13 2022] DELETE /identity/v3/users/f55e1b6c2eb0426ab74d26c7fb887964 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:14.082290 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.083858 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:14.097668 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c95b7-df1a-49bd-add8-635cac2d38d3 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.157153 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.157803 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.158059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.158332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] PATH_INFO: `/v3/projects/405678c875f740e6a3cd60838b07c1df` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.159474 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405678c875f740e6a3cd60838b07c1df)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.161453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.177577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:14.209802 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405678c875f740e6a3cd60838b07c1df', 'request_id': 'req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:14.215504 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405678c875f740e6a3cd60838b07c1df', 'request_id': 'req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:14.221699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405678c875f740e6a3cd60838b07c1df', 'request_id': 'req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:14.233988 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] The token cache is being invalidate because project 405678c875f740e6a3cd60838b07c1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:14.234271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:14.234882 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-0e248a8b-5af3-4ba2-9a5f-dfa0c8278e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:14.236366 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1434/2887] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:14 2022] DELETE /identity/v3/projects/405678c875f740e6a3cd60838b07c1df => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:14.241195 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1981b-2f2a-4e7a-85c1-7df89abda9dd None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.241669 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1981b-2f2a-4e7a-85c1-7df89abda9dd None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.241781 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1981b-2f2a-4e7a-85c1-7df89abda9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.261301 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-6da1981b-2f2a-4e7a-85c1-7df89abda9dd None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:14.262505 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-6da1981b-2f2a-4e7a-85c1-7df89abda9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:14.325677 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1454/2888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:14.334017 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6ab1e-8e34-4e3b-a57d-e866e7bc3577 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.334298 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6ab1e-8e34-4e3b-a57d-e866e7bc3577 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.334567 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6ab1e-8e34-4e3b-a57d-e866e7bc3577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.354395 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-7bf6ab1e-8e34-4e3b-a57d-e866e7bc3577 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:14.355578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-7bf6ab1e-8e34-4e3b-a57d-e866e7bc3577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:14.363297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1435/2889] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:14.367579 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1981b-2f2a-4e7a-85c1-7df89abda9dd None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.377334 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1981b-2f2a-4e7a-85c1-7df89abda9dd None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.382375 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.382994 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.383276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.383549 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.384191 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:14.384562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.386139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.388422 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:14.399440 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1455/2890] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:42:14.403426 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6ab1e-8e34-4e3b-a57d-e866e7bc3577 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.412488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6ab1e-8e34-4e3b-a57d-e866e7bc3577 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.417116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.417693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.417969 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.418237 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.418868 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.420791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.447169 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1436/2891] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:14 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:14.451420 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.461890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7779-2453-4ae7-9f1c-6135629f7a34 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.516792 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.517391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.517673 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.517949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.518572 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.520504 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.541284 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1456/2892] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:14 2022] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:14.547013 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.557137 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8adc-8b3c-4647-a460-0b2e4ef907cc admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.561683 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.562267 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.562547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.562821 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.563453 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.565096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.575240 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1437/2893] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:14.579079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.589481 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408ac74-060e-4334-aa44-4fa50310d74b admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.594239 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d38b74-7a3a-417f-bb88-5878ca9568d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.594867 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38b74-7a3a-417f-bb88-5878ca9568d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.595184 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38b74-7a3a-417f-bb88-5878ca9568d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.595461 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38b74-7a3a-417f-bb88-5878ca9568d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.596137 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d38b74-7a3a-417f-bb88-5878ca9568d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.597948 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d38b74-7a3a-417f-bb88-5878ca9568d8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.608716 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1457/2894] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:14.617035 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.630736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1bfa-6876-49bd-9911-b018afd02112 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.635514 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.636302 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.636643 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.637154 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] PATH_INFO: `/v3/projects/6ebcd411dee549b8a4cdf0f4379d79ec/users/b663a5cbb3174fd08a9ccb67fba584ca/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.652207 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebcd411dee549b8a4cdf0f4379d79ec, user_id=b663a5cbb3174fd08a9ccb67fba584ca, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.654887 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.667324 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1438/2895] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:14 2022] PUT /identity/v3/projects/6ebcd411dee549b8a4cdf0f4379d79ec/users/b663a5cbb3174fd08a9ccb67fba584ca/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:14.677435 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf636f0-1be2-4883-9e27-871344fd52d5 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.677744 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf636f0-1be2-4883-9e27-871344fd52d5 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.678094 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf636f0-1be2-4883-9e27-871344fd52d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.706175 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-ddf636f0-1be2-4883-9e27-871344fd52d5 None None] MFA Rules not processed for user `b663a5cbb3174fd08a9ccb67fba584ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:14.707391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-ddf636f0-1be2-4883-9e27-871344fd52d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:14.769696 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1458/2896] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:14.803418 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.805128 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:14.860797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91765b-06eb-4fff-b6ea-a6eac273c9e5 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.864991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a8b3-7fff-4411-8a03-93d172a4f2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.865670 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a8b3-7fff-4411-8a03-93d172a4f2aa service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.865952 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a8b3-7fff-4411-8a03-93d172a4f2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.866226 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a8b3-7fff-4411-8a03-93d172a4f2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.874797 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a8b3-7fff-4411-8a03-93d172a4f2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.876525 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a8b3-7fff-4411-8a03-93d172a4f2aa service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.885822 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1439/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:14.901209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf636f0-1be2-4883-9e27-871344fd52d5 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:14.962287 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf636f0-1be2-4883-9e27-871344fd52d5 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:14.966890 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:14.967512 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:14.967791 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:14.968065 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] PATH_INFO: `/v3/users/b663a5cbb3174fd08a9ccb67fba584ca` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:14.969214 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b663a5cbb3174fd08a9ccb67fba584ca)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:14.971123 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:14.975517 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:15.017930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b663a5cbb3174fd08a9ccb67fba584ca'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.025086 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b663a5cbb3174fd08a9ccb67fba584ca'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.025706 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b663a5cbb3174fd08a9ccb67fba584ca'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.032526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b663a5cbb3174fd08a9ccb67fba584ca'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.043875 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b663a5cbb3174fd08a9ccb67fba584ca'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.049587 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1459/2898] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:14 2022] DELETE /identity/v3/users/b663a5cbb3174fd08a9ccb67fba584ca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:15.054991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.055275 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.055547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.074577 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:15.075750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:15.112565 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:15.134881 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1440/2899] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:15.144695 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.146139 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:15.202518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616ce5-9412-4e48-81c2-5da879bbf937 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.206543 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169d41a-c4f4-48c4-bc2b-cc553b44ae56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.206928 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d41a-c4f4-48c4-bc2b-cc553b44ae56 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.207199 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d41a-c4f4-48c4-bc2b-cc553b44ae56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.207479 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169d41a-c4f4-48c4-bc2b-cc553b44ae56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.218023 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169d41a-c4f4-48c4-bc2b-cc553b44ae56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:15.219445 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169d41a-c4f4-48c4-bc2b-cc553b44ae56 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:15.229342 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1460/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:15.494415 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.495907 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:15.508165 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90a22b-d648-4836-bb56-cfbdca1f743e None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.512961 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.513601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.513884 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.514159 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] PATH_INFO: `/v3/projects/6ebcd411dee549b8a4cdf0f4379d79ec` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.515277 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebcd411dee549b8a4cdf0f4379d79ec)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:15.517247 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:15.564536 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebcd411dee549b8a4cdf0f4379d79ec', 'request_id': 'req-cde2a024-0cf4-422b-a682-b471435be957'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.571179 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebcd411dee549b8a4cdf0f4379d79ec', 'request_id': 'req-cde2a024-0cf4-422b-a682-b471435be957'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.578216 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebcd411dee549b8a4cdf0f4379d79ec', 'request_id': 'req-cde2a024-0cf4-422b-a682-b471435be957'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.591253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] The token cache is being invalidate because project 6ebcd411dee549b8a4cdf0f4379d79ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:15.591665 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.592332 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-cde2a024-0cf4-422b-a682-b471435be957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:15.593819 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1441/2901] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:15 2022] DELETE /identity/v3/projects/6ebcd411dee549b8a4cdf0f4379d79ec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:15.599384 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317bb1f-3a91-44b9-83b0-b6164a9be862 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.599866 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317bb1f-3a91-44b9-83b0-b6164a9be862 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.599969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317bb1f-3a91-44b9-83b0-b6164a9be862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.620583 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-0317bb1f-3a91-44b9-83b0-b6164a9be862 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:15.621708 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-0317bb1f-3a91-44b9-83b0-b6164a9be862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:15.679401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1461/2902] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:15.687171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362154-6f6a-4ca3-82df-9d0211dbe8b8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.687454 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362154-6f6a-4ca3-82df-9d0211dbe8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.687657 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362154-6f6a-4ca3-82df-9d0211dbe8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.709693 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-97362154-6f6a-4ca3-82df-9d0211dbe8b8 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:15.710897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-97362154-6f6a-4ca3-82df-9d0211dbe8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:15.718812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1442/2903] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:15.723084 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317bb1f-3a91-44b9-83b0-b6164a9be862 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.732807 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317bb1f-3a91-44b9-83b0-b6164a9be862 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.737333 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.737931 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.738211 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.738485 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.739132 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:15.739968 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:15.741671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:15.753104 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1462/2904] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:42:15.757768 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362154-6f6a-4ca3-82df-9d0211dbe8b8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.766699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362154-6f6a-4ca3-82df-9d0211dbe8b8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.771287 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.771870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.772151 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.772469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.773086 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:15.774986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:15.801346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1443/2905] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:15 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:15.805959 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.815736 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015048b1-b7c6-424d-9735-ac6648c609c3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.824886 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:15.873946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.874488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.874766 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.875035 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.875678 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:15.877854 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:15.899209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1463/2906] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:15 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:15.903371 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.914112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9478964-66a6-4504-b601-302dd91fa294 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.918978 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.919578 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.919861 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.920140 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.920820 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:15.922422 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:15.932855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1444/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:15.936601 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.946189 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db290d5-d95f-4a29-9fec-1d66b17de2ee admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.950691 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159609a3-e41f-4876-ab24-049631c678ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.951269 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159609a3-e41f-4876-ab24-049631c678ca admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.951546 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159609a3-e41f-4876-ab24-049631c678ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.951820 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159609a3-e41f-4876-ab24-049631c678ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.952489 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159609a3-e41f-4876-ab24-049631c678ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:15.954079 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159609a3-e41f-4876-ab24-049631c678ca admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:15.964257 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1464/2908] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:15.968116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:15.978469 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442f70a-1a2f-46a4-9a3d-5a19e621513e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:15.983187 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:15.983834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:15.984116 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:15.984438 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] PATH_INFO: `/v3/projects/614d6c3fb48e42b0bb16abc47c1948c6/users/0bd5f4fa25e3448ea8c2229648c3f47f/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:15.999430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=614d6c3fb48e42b0bb16abc47c1948c6, user_id=0bd5f4fa25e3448ea8c2229648c3f47f, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.002503 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.016509 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1445/2909] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:15 2022] PUT /identity/v3/projects/614d6c3fb48e42b0bb16abc47c1948c6/users/0bd5f4fa25e3448ea8c2229648c3f47f/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:16.027894 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d4fd-0123-4418-88b1-4c76f961d40d None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.028176 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d4fd-0123-4418-88b1-4c76f961d40d None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.028582 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d4fd-0123-4418-88b1-4c76f961d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.056799 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-49e5d4fd-0123-4418-88b1-4c76f961d40d None None] MFA Rules not processed for user `0bd5f4fa25e3448ea8c2229648c3f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:16.057997 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-49e5d4fd-0123-4418-88b1-4c76f961d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:16.119620 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1465/2910] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:16.124163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.184698 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6218b9-c381-4fd5-849b-48d41cfab57a admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.189316 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.189909 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.190217 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.190488 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.191117 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.193063 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.198257 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:16.221937 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1446/2911] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:16 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:16.226694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5d4fd-0123-4418-88b1-4c76f961d40d None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.237307 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5d4fd-0123-4418-88b1-4c76f961d40d None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.292136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.292763 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.293041 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.293320 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.293950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.295860 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.315969 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1466/2912] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:16 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:16.320002 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.330058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529977b1-15ad-4211-b493-a76fac0e2275 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.335102 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.335691 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.335967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.336233 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.336890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.338499 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.348817 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1447/2913] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:16.353281 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.363177 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c38839-eb29-4057-9ced-d046f8c23040 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.367897 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9e375-cf7c-4c9f-9b38-8bccf6956eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.368528 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e375-cf7c-4c9f-9b38-8bccf6956eda admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.368844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e375-cf7c-4c9f-9b38-8bccf6956eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.369121 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e375-cf7c-4c9f-9b38-8bccf6956eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.369764 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e375-cf7c-4c9f-9b38-8bccf6956eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.371356 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e375-cf7c-4c9f-9b38-8bccf6956eda admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.376809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:16.382299 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1467/2914] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:16.386054 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.395782 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43168a-61c9-4247-bfad-165e43ba24f8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.400930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.401569 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.401850 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.402121 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] PATH_INFO: `/v3/projects/699af472b1b44cc28f844749f13891e6/users/c63f94e3079a4124a41aca77a6a5a0fc/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.417389 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699af472b1b44cc28f844749f13891e6, user_id=c63f94e3079a4124a41aca77a6a5a0fc, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.420059 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.432622 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1448/2915] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:16 2022] PUT /identity/v3/projects/699af472b1b44cc28f844749f13891e6/users/c63f94e3079a4124a41aca77a6a5a0fc/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:16.442733 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292004a3-e02b-48ed-8929-da4a9884d691 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.443030 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292004a3-e02b-48ed-8929-da4a9884d691 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.443311 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292004a3-e02b-48ed-8929-da4a9884d691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.470946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-292004a3-e02b-48ed-8929-da4a9884d691 None None] MFA Rules not processed for user `c63f94e3079a4124a41aca77a6a5a0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:16.472172 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-292004a3-e02b-48ed-8929-da4a9884d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:16.535202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1468/2916] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:16.540447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.601416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10c02-6772-42d0-83b1-753ba09f2d97 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.606020 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.606617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.606897 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.607171 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.607787 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.609723 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.636163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1449/2917] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:16 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:16.640092 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292004a3-e02b-48ed-8929-da4a9884d691 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.651270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292004a3-e02b-48ed-8929-da4a9884d691 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.706127 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.706903 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.707185 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.707459 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.708093 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.710652 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.730879 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1469/2918] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:16 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:16.734870 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.744989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713dae5-4279-4477-8ce7-8775aa82fb52 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.749563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.750150 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.750430 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.750704 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.751598 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.753225 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.763917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1450/2919] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:16.767659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.777788 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9595c3-d462-44c1-9c49-95969e893ef8 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.782265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.782906 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.783181 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.783454 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] PATH_INFO: `/v3/projects/6a5742bdceda44c28c80036bbbc7621d/users/7254551dbd614263b47236a0c843d065/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.797531 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5742bdceda44c28c80036bbbc7621d, user_id=7254551dbd614263b47236a0c843d065, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.800157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.812207 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1470/2920] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:16 2022] PUT /identity/v3/projects/6a5742bdceda44c28c80036bbbc7621d/users/7254551dbd614263b47236a0c843d065/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:16.816139 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.826429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c241e-e9a2-4bea-a798-be0fc25e608e admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.882573 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7b846-5fcf-4788-9fe2-ae6bdc83957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.883183 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7b846-5fcf-4788-9fe2-ae6bdc83957b admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.883465 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7b846-5fcf-4788-9fe2-ae6bdc83957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.883739 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7b846-5fcf-4788-9fe2-ae6bdc83957b admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.884404 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7b846-5fcf-4788-9fe2-ae6bdc83957b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.885994 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7b846-5fcf-4788-9fe2-ae6bdc83957b admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.895495 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1451/2921] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:16.900950 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:16.911360 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758128-5508-44fa-9d98-2222f5d0aa46 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:16.915892 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:16.916566 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.916844 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.917115 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] PATH_INFO: `/v3/projects/6a5742bdceda44c28c80036bbbc7621d/users/7254551dbd614263b47236a0c843d065/roles/7407c800e8af41e2bc429a186be077ba` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.919013 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5742bdceda44c28c80036bbbc7621d, user_id=7254551dbd614263b47236a0c843d065, role_id=7407c800e8af41e2bc429a186be077ba)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:16.921681 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:16.931671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1471/2922] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:16 2022] PUT /identity/v3/projects/6a5742bdceda44c28c80036bbbc7621d/users/7254551dbd614263b47236a0c843d065/roles/7407c800e8af41e2bc429a186be077ba => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:16.941516 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:16.941834 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:16.942144 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:16.970347 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] MFA Rules not processed for user `7254551dbd614263b47236a0c843d065`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:16.971544 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:16.980447 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:17.040434 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1452/2923] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:17.051777 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:17.054090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:17.101019 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:17.113393 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a844fe-aff2-4c7c-b3d9-95723f2b6593 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:17.117537 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:17.118136 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:17.118417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:17.118694 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:17.173332 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:17.174702 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:17.184039 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1472/2924] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:18.683608 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:18.685036 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:18.696736 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbd083-c992-4867-863c-e223d7d3e058 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:18.700471 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:18.701071 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:18.701349 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:18.701621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:18.759362 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:18.760750 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:18.769339 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1453/2925] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:19.283731 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:19.292206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43306-9837-4293-a38e-52a6d4861dc5 service cinder] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:19.295809 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7e29-d41c-4131-9517-4cb6beaeb73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:19.296434 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7e29-d41c-4131-9517-4cb6beaeb73e service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:19.296715 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7e29-d41c-4131-9517-4cb6beaeb73e service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:19.296988 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7e29-d41c-4131-9517-4cb6beaeb73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:19.306074 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7e29-d41c-4131-9517-4cb6beaeb73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:19.307473 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7e29-d41c-4131-9517-4cb6beaeb73e service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:19.316595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1473/2926] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:23.175879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:23.235129 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcc0b-dc9c-4a0d-b99a-e7ccff76a84e service cinder] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:23.239605 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:23.240439 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:23.240714 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:23.240980 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] PATH_INFO: `/v3/users/0bd5f4fa25e3448ea8c2229648c3f47f` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:23.242074 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd5f4fa25e3448ea8c2229648c3f47f)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:23.243971 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:23.289641 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd5f4fa25e3448ea8c2229648c3f47f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.291245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:23.297048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd5f4fa25e3448ea8c2229648c3f47f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.298048 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd5f4fa25e3448ea8c2229648c3f47f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.311519 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd5f4fa25e3448ea8c2229648c3f47f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.319079 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd5f4fa25e3448ea8c2229648c3f47f'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.325110 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1454/2927] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:23 2022] DELETE /identity/v3/users/0bd5f4fa25e3448ea8c2229648c3f47f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:23.329982 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:23.330659 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:23.330893 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:23.350209 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:23.351401 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:23.408143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1474/2928] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:23.417745 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:23.419166 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:23.475251 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7204c-625c-46b7-afc7-a64e2cfa5f74 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:23.478966 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:23.479563 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:23.479840 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:23.480163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:23.489097 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:23.490515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:23.499655 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1455/2929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:23.761112 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:23.762547 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:23.774949 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4a538-7f55-4605-98af-f60a72e90880 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:23.779643 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:23.780391 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:23.780576 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:23.780937 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] PATH_INFO: `/v3/projects/614d6c3fb48e42b0bb16abc47c1948c6` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:23.782055 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=614d6c3fb48e42b0bb16abc47c1948c6)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:23.784064 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:23.831146 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614d6c3fb48e42b0bb16abc47c1948c6', 'request_id': 'req-c9426c8b-cd6f-4517-9973-ec1630dde127'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.838417 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614d6c3fb48e42b0bb16abc47c1948c6', 'request_id': 'req-c9426c8b-cd6f-4517-9973-ec1630dde127'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.844067 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614d6c3fb48e42b0bb16abc47c1948c6', 'request_id': 'req-c9426c8b-cd6f-4517-9973-ec1630dde127'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.855930 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] The token cache is being invalidate because project 614d6c3fb48e42b0bb16abc47c1948c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:23.856378 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.857157 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.858796 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1475/2930] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:23 2022] DELETE /identity/v3/projects/614d6c3fb48e42b0bb16abc47c1948c6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:23.862712 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:23.872635 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e65f0-c8df-452b-811f-dfe3d456f368 service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:23.926653 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:23.927284 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:23.928064 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:23.928385 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] PATH_INFO: `/v3/users/c63f94e3079a4124a41aca77a6a5a0fc` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:23.929483 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63f94e3079a4124a41aca77a6a5a0fc)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:23.931402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:23.976093 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63f94e3079a4124a41aca77a6a5a0fc'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.983228 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63f94e3079a4124a41aca77a6a5a0fc'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.983852 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63f94e3079a4124a41aca77a6a5a0fc'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:23.995077 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:23.996245 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63f94e3079a4124a41aca77a6a5a0fc'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.005547 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63f94e3079a4124a41aca77a6a5a0fc'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.012338 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1456/2931] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:23 2022] DELETE /identity/v3/users/c63f94e3079a4124a41aca77a6a5a0fc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:24.282798 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:24.284237 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:24.297548 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426c8b-cd6f-4517-9973-ec1630dde127 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:24.301427 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:24.360586 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:24.361250 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:24.361486 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:24.361760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] PATH_INFO: `/v3/projects/699af472b1b44cc28f844749f13891e6` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:24.362873 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699af472b1b44cc28f844749f13891e6)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:24.364827 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:24.410357 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699af472b1b44cc28f844749f13891e6', 'request_id': 'req-3bfb919a-89e8-4a44-ab48-a4e7a7866888'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.418426 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699af472b1b44cc28f844749f13891e6', 'request_id': 'req-3bfb919a-89e8-4a44-ab48-a4e7a7866888'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.424569 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699af472b1b44cc28f844749f13891e6', 'request_id': 'req-3bfb919a-89e8-4a44-ab48-a4e7a7866888'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.436351 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] The token cache is being invalidate because project 699af472b1b44cc28f844749f13891e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:24.436639 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.437255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.438953 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1476/2932] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:24 2022] DELETE /identity/v3/projects/699af472b1b44cc28f844749f13891e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:24.442889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:24.444468 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:24.456865 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37895-ff71-4c48-94c8-e943a8c7b406 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:24.512346 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:24.512894 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:24.513180 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:24.513459 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] PATH_INFO: `/v3/users/7254551dbd614263b47236a0c843d065` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:24.514546 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7254551dbd614263b47236a0c843d065)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:24.516494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:24.561606 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7254551dbd614263b47236a0c843d065'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.568647 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7254551dbd614263b47236a0c843d065'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.569263 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7254551dbd614263b47236a0c843d065'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.581099 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7254551dbd614263b47236a0c843d065'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.588391 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-b0f3b7b0-3905-4f76-8f2c-39afe819dd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7254551dbd614263b47236a0c843d065'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:24.594113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1457/2933] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:24 2022] DELETE /identity/v3/users/7254551dbd614263b47236a0c843d065 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:24.872712 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:24.874255 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:24.888160 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb919a-89e8-4a44-ab48-a4e7a7866888 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:24.944826 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:24.945456 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:24.945740 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:24.946015 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] PATH_INFO: `/v3/projects/6a5742bdceda44c28c80036bbbc7621d` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:24.947128 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5742bdceda44c28c80036bbbc7621d)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:24.949072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:24.994014 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:25.003389 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5742bdceda44c28c80036bbbc7621d', 'request_id': 'req-d57181af-d53d-4dc3-8e01-1bc904530d15'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:25.010769 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5742bdceda44c28c80036bbbc7621d', 'request_id': 'req-d57181af-d53d-4dc3-8e01-1bc904530d15'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:25.016328 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5742bdceda44c28c80036bbbc7621d', 'request_id': 'req-d57181af-d53d-4dc3-8e01-1bc904530d15'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:25.028201 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] The token cache is being invalidate because project 6a5742bdceda44c28c80036bbbc7621d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:25.028525 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:25.029205 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-d57181af-d53d-4dc3-8e01-1bc904530d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:25.030692 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1477/2934] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:24 2022] DELETE /identity/v3/projects/6a5742bdceda44c28c80036bbbc7621d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:25.035917 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc146b-984b-493d-82b9-16dbeeeca25d None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.036253 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc146b-984b-493d-82b9-16dbeeeca25d None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.036554 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc146b-984b-493d-82b9-16dbeeeca25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.055742 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-43bc146b-984b-493d-82b9-16dbeeeca25d None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:25.056889 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-43bc146b-984b-493d-82b9-16dbeeeca25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:25.113747 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1458/2935] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:25.121590 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe2d1-7a11-41ec-a41a-201cc5306aff None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.121884 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe2d1-7a11-41ec-a41a-201cc5306aff None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.122166 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe2d1-7a11-41ec-a41a-201cc5306aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.142379 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-7edbe2d1-7a11-41ec-a41a-201cc5306aff None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:25.143595 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-7edbe2d1-7a11-41ec-a41a-201cc5306aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:25.152179 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1478/2936] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:25.156357 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc146b-984b-493d-82b9-16dbeeeca25d None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:25.165939 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc146b-984b-493d-82b9-16dbeeeca25d None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:25.170480 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:25.171069 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.171348 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.171621 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] PATH_INFO: `/v3/domains` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.172261 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 05:42:25.172594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:25.174181 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:25.175575 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:25.187096 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1459/2937] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 21 05:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 05:42:25.190945 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe2d1-7a11-41ec-a41a-201cc5306aff None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:25.200672 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe2d1-7a11-41ec-a41a-201cc5306aff None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:25.205363 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:25.205962 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.206243 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.206518 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.207151 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:25.209726 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:25.235830 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1479/2938] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 21 05:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 05:42:25.240518 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:25.250384 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59ce2f-cb39-4bb0-9f5c-5383e67e8206 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:25.308168 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:25.308764 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.309047 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.309326 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.309949 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:25.311878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:25.334358 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1460/2939] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 21 05:42:25 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 05:42:25.338979 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:25.349648 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7373-41b5-4246-a032-23d3d411b3e3 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:25.354218 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:25.354816 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.355097 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.355372 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.356040 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:25.357671 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:25.367752 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1480/2940] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:25.371682 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:25.382425 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34990b5-fe37-44ec-aebd-0ca4cbad7bb8 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:25.387058 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd8174-fbe1-4db3-a7b1-153bf9919fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:25.387651 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd8174-fbe1-4db3-a7b1-153bf9919fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.387936 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd8174-fbe1-4db3-a7b1-153bf9919fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.388210 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd8174-fbe1-4db3-a7b1-153bf9919fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.388880 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd8174-fbe1-4db3-a7b1-153bf9919fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:25.390510 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd8174-fbe1-4db3-a7b1-153bf9919fe2 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:25.400855 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1461/2941] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 21 05:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 05:42:25.405007 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:25.414869 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a1af1-3069-4fc7-8ed6-297084356a9a admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:25.419568 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:25.420213 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.420526 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.420804 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] PATH_INFO: `/v3/projects/337cfd29607b4dbca635059f9d0c9e36/users/c10f1727c3d94d8ea1c5a7c68a177959/roles/75d345ed873a4df3be5afc217fb2676f` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.435815 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=337cfd29607b4dbca635059f9d0c9e36, user_id=c10f1727c3d94d8ea1c5a7c68a177959, role_id=75d345ed873a4df3be5afc217fb2676f)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:25.438536 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:25.451946 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1481/2942] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 21 05:42:25 2022] PUT /identity/v3/projects/337cfd29607b4dbca635059f9d0c9e36/users/c10f1727c3d94d8ea1c5a7c68a177959/roles/75d345ed873a4df3be5afc217fb2676f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 05:42:25.462402 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ab21-89e6-4fe4-9c29-66b63f0ee0d8 None None] REQUEST_METHOD: `POST` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.462879 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ab21-89e6-4fe4-9c29-66b63f0ee0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.462991 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ab21-89e6-4fe4-9c29-66b63f0ee0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.491558 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.auth.core [None req-10b4ab21-89e6-4fe4-9c29-66b63f0ee0d8 None None] MFA Rules not processed for user `c10f1727c3d94d8ea1c5a7c68a177959`. Rule list: `[]` (Enabled: `True`). {{(pid=81351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:25.492773 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-10b4ab21-89e6-4fe4-9c29-66b63f0ee0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:25.554297 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1462/2943] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:25.564762 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:25.566474 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:25.624701 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54d1b1-68fc-4fb4-a18b-ccd06b54c3dd admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:25.628551 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd00cb-2540-40ff-960e-033b3640b302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d585fa74ead490abff52d8b03f850fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:25.629149 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd00cb-2540-40ff-960e-033b3640b302 service cinder] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:25.629423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd00cb-2540-40ff-960e-033b3640b302 service cinder] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:25.629690 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd00cb-2540-40ff-960e-033b3640b302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:25.638029 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd00cb-2540-40ff-960e-033b3640b302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:25.639447 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd00cb-2540-40ff-960e-033b3640b302 service cinder] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:25.648267 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1482/2944] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:35.550990 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:35.631073 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ab21-89e6-4fe4-9c29-66b63f0ee0d8 None None] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:35.644263 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:35.696458 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ab21-89e6-4fe4-9c29-66b63f0ee0d8 None None] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:35.702271 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:35.702910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:35.703191 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:35.703466 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] PATH_INFO: `/v3/users/c10f1727c3d94d8ea1c5a7c68a177959` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:35.704754 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10f1727c3d94d8ea1c5a7c68a177959)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:35.706910 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:35.751890 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10f1727c3d94d8ea1c5a7c68a177959'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:35.759367 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10f1727c3d94d8ea1c5a7c68a177959'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:35.759989 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10f1727c3d94d8ea1c5a7c68a177959'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:35.771648 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10f1727c3d94d8ea1c5a7c68a177959'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:35.778429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10f1727c3d94d8ea1c5a7c68a177959'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:35.784337 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1463/2945] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:42:35 2022] DELETE /identity/v3/users/c10f1727c3d94d8ea1c5a7c68a177959 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:35.788940 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] REQUEST_METHOD: `POST` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:35.789231 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:35.789509 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:35.812423 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.auth.core [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] MFA Rules not processed for user `c3a7560fcbf84596bbf53086e9d2d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 05:42:35.813617 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:35.872904 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1483/2946] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 21 05:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 05:42:35.883369 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:35.884791 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:35.939515 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3482943-51b2-4e22-8a1c-546419065f50 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:35.943101 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:35.943692 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:35.943967 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:35.944291 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:35.953663 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:35.955274 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:35.964632 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1464/2947] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:42:36.232090 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:42:36.233542 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:42:36.247529 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55cba7-d3be-45ee-890e-35857d5f66d1 None None] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:42:36.252488 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:42:36.253761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:42:36.254217 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:42:36.254500 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] PATH_INFO: `/v3/projects/337cfd29607b4dbca635059f9d0c9e36` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:42:36.255819 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] RBAC: Authorizing `identity:delete_project(project_id=337cfd29607b4dbca635059f9d0c9e36)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:42:36.257761 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:42:36.302687 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337cfd29607b4dbca635059f9d0c9e36', 'request_id': 'req-f22c3e34-e39e-4375-97fc-74afa8fc830d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:36.310036 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337cfd29607b4dbca635059f9d0c9e36', 'request_id': 'req-f22c3e34-e39e-4375-97fc-74afa8fc830d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:36.316319 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337cfd29607b4dbca635059f9d0c9e36', 'request_id': 'req-f22c3e34-e39e-4375-97fc-74afa8fc830d'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:36.327105 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] The token cache is being invalidate because project 337cfd29607b4dbca635059f9d0c9e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:42:36.327390 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:36.328021 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:42:36.329573 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1484/2948] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:42:36 2022] DELETE /identity/v3/projects/337cfd29607b4dbca635059f9d0c9e36 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:42:45.960548 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:42:46.324162 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:43:04.443113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:43:04.444594 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:43:04.455752 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0fe1-39dc-4cdd-96ab-f85c0e4e0e0b service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:43:04.504341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:43:04.504940 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:43:04.505221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:43:04.505494 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:43:04.507205 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:43:04.563112 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:43:04.564572 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:43:04.573812 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1465/2949] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:43:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:43:10.738913 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:43:10.740399 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:43:10.752914 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c3e34-e39e-4375-97fc-74afa8fc830d admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:43:10.756457 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354351c3e9d41d09ea2610b47cefa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:43:10.757049 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] REQUEST_METHOD: `GET` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:43:10.757330 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:43:10.757613 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:43:10.759276 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:43:10.821072 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:43:10.823059 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:43:10.832734 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1485/2950] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:43:14.569232 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=48 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:43:16.994774 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:43:16.996209 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:43:17.010832 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de3e2-bd2d-408a-a20c-3e003ea4f82c service neutron] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:43:17.015406 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:43:17.016033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:43:17.016341 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:43:17.016617 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] PATH_INFO: `/v3/users/7f0be2b3fa404e69890ed0ba58515c8d` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:43:17.017711 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0be2b3fa404e69890ed0ba58515c8d)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:43:17.019625 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:43:17.068947 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0be2b3fa404e69890ed0ba58515c8d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.076429 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0be2b3fa404e69890ed0ba58515c8d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.077033 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0be2b3fa404e69890ed0ba58515c8d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.088645 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0be2b3fa404e69890ed0ba58515c8d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.095272 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0be2b3fa404e69890ed0ba58515c8d'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.101083 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1466/2951] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:43:16 2022] DELETE /identity/v3/users/7f0be2b3fa404e69890ed0ba58515c8d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:43:17.272704 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:43:17.282999 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1195-db97-4d04-ad4f-9d9615e8a692 service neutron] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:43:17.338318 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:43:17.338941 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:43:17.339219 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:43:17.339491 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] PATH_INFO: `/v3/projects/60f64523e46844c59a817d3d5b69361e` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:43:17.340641 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f64523e46844c59a817d3d5b69361e)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:43:17.342562 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:43:17.391563 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f64523e46844c59a817d3d5b69361e', 'request_id': 'req-90806c05-b80f-49d3-a98f-023486134834'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.399215 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f64523e46844c59a817d3d5b69361e', 'request_id': 'req-90806c05-b80f-49d3-a98f-023486134834'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.404898 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f64523e46844c59a817d3d5b69361e', 'request_id': 'req-90806c05-b80f-49d3-a98f-023486134834'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.416760 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] The token cache is being invalidate because project 60f64523e46844c59a817d3d5b69361e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:43:17.417052 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.417713 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.419206 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1486/2952] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:43:17 2022] DELETE /identity/v3/projects/60f64523e46844c59a817d3d5b69361e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:43:17.423172 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:43:17.424661 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:43:17.438744 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec6f2c-b8c9-481b-a378-06817f59da59 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:43:17.499416 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:43:17.500221 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:43:17.500531 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:43:17.500805 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] PATH_INFO: `/v3/users/7ea30998804e43c096baf417da9ea158` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:43:17.502289 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea30998804e43c096baf417da9ea158)` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:43:17.504301 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:43:17.549864 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea30998804e43c096baf417da9ea158'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.557314 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea30998804e43c096baf417da9ea158'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.557930 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea30998804e43c096baf417da9ea158'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.569710 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea30998804e43c096baf417da9ea158'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.571593 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:43:17.577351 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.notifications [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea30998804e43c096baf417da9ea158'} {{(pid=81351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.583955 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1467/2953] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 21 05:43:17 2022] DELETE /identity/v3/users/7ea30998804e43c096baf417da9ea158 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:43:17.749270 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Authenticating user token {{(pid=81350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:43:17.750975 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.fernet_utils [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:43:17.764143 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90806c05-b80f-49d3-a98f-023486134834 admin admin] Validating token access rules against request {{(pid=81350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:43:17.785400 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:43:17.822885 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a7560fcbf84596bbf53086e9d2d4b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f856f4ace59d412c839fff1b080f7b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:43:17.823511 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:43:17.823795 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:43:17.824057 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] PATH_INFO: `/v3/projects/a3735b7136ed4a249454bfb6f8233b06` {{(pid=81350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:43:17.825202 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3735b7136ed4a249454bfb6f8233b06)` {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:43:17.827091 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] RBAC: Authorization granted {{(pid=81350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:43:17.873337 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3735b7136ed4a249454bfb6f8233b06', 'request_id': 'req-a4cec646-f9ec-4423-b9ae-36ed1744b460'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.880970 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3735b7136ed4a249454bfb6f8233b06', 'request_id': 'req-a4cec646-f9ec-4423-b9ae-36ed1744b460'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.886433 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3735b7136ed4a249454bfb6f8233b06', 'request_id': 'req-a4cec646-f9ec-4423-b9ae-36ed1744b460'} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.897265 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] The token cache is being invalidate because project a3735b7136ed4a249454bfb6f8233b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 05:43:17.897557 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.898186 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG keystone.notifications [None req-a4cec646-f9ec-4423-b9ae-36ed1744b460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 05:43:17.899703 dv-cinder-849143-5-smb devstack@keystone.service[81350]: [pid: 81350|app: 0|req: 1487/2954] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 21 05:43:17 2022] DELETE /identity/v3/projects/a3735b7136ed4a249454bfb6f8233b06 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 05:43:27.583113 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=4 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:43:27.894340 dv-cinder-849143-5-smb devstack@keystone.service[81350]: DEBUG dbcounter [-] [81350] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 05:46:21.453163 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Authenticating user token {{(pid=81351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 05:46:21.454601 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:46:21.600878 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea481c7d-23ac-427e-8ae1-76770c95af84 admin admin] Validating token access rules against request {{(pid=81351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 05:46:21.658699 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c4282-01a1-4fe8-9406-caf4610b2cab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5129b0c17f1a4579b26a2e50369648d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d48605b85744148b56f5b8b79c213f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 05:46:21.659355 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c4282-01a1-4fe8-9406-caf4610b2cab service placement] REQUEST_METHOD: `GET` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 05:46:21.659633 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c4282-01a1-4fe8-9406-caf4610b2cab service placement] SCRIPT_NAME: `/identity` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 05:46:21.659905 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c4282-01a1-4fe8-9406-caf4610b2cab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 05:46:21.661720 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.fernet_utils [None req-3d2c4282-01a1-4fe8-9406-caf4610b2cab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 05:46:21.672722 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c4282-01a1-4fe8-9406-caf4610b2cab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 05:46:21.674288 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c4282-01a1-4fe8-9406-caf4610b2cab service placement] RBAC: Authorization granted {{(pid=81351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 05:46:21.683986 dv-cinder-849143-5-smb devstack@keystone.service[81351]: [pid: 81351|app: 0|req: 1468/2955] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 21 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 05:46:31.679634 dv-cinder-849143-5-smb devstack@keystone.service[81351]: DEBUG dbcounter [-] [81351] Writing DB stats keystone:SELECT=89 {{(pid=81351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}